Data Engineer

OptomiJersey City, United States
ContractOn-siteMidLimited info disclosed
12 views0 applications

Description

US Citizens or Green Card Holders only! Overview : We are seeking a skilled Data Engineer to build and support enterprise-grade production systems. The ideal candidate will have strong hands-on skills in PySpark, Python, and SQL, with experience in building, operating, and optimizing data pipelines. Additionally, candidates with application engineering experience should have proficiency in building APIs using FastAPI or Flask and possess robust data modeling skills. Experience integrating AI and LLMs into workflows to enhance data quality and automate processes is highly desirable. Required Skills: 7+ years of engineering experience AWS Cloud expertise Databricks expertise Skilled in PySpark, Python and SQL Nice-to-haves: Data modeling skills (e.g., Pydantic) AI/LLM experience experience building APIs and backend services using FastAPI or Flask. What the responsibilities are of the right candidate: Build and support enterprise-grade production systems Optimize batch/streaming data pipelines Integrate AI and LLMs into data platforms Enhance data quality and automate processes