Data Engineer

Position Summary: We are seeking a skilled professional to build and support enterprise-grade production systems. The ideal candidate will have strong hands-on skills in PySpark, Python, and SQL, with experience in building, operating, and optimizing data pipelines. Additionally, candidates with application engineering experience should have proficiency in building APIs using FastAPI or Flask and possess robust data modeling skills. Experience integrating AI and LLMs into workflows to enhance data quality and automate processes is highly desirable. What the right candidate will enjoy: Working with cutting-edge AI technologies Opportunities to enhance data quality and observability Automating and optimizing data lifecycle processes What type of experience does the right candidate have: Strong hands-on skills in PySpark, Python, and SQL AWS experience (recent workplace experience is highly favored) Databricks expertise Experience with FastAPI or Flask for building APIs Practical experience with AI and LLMs What the responsibilities are of the right candidate: Build and support enterprise-grade production systems Optimize batch/streaming data pipelines Integrate AI and LLMs into data platforms Enhance data quality and automate processes