Lead Data Engineer Job at Openkyber, Atlanta, GA

  • Openkyber
  • Atlanta, GA

Job Description

job summary: We are seeking an experienced Databricks Data Engineer to join our high-performing Data & AI practice in Phoenix, AZ. In this role, you will be responsible for designing and deploying enterprise-grade Lakehouse solutions on Google Cloud Platform (Google Cloud Platform). You will build robust batch and real-time data pipelines, optimize ETL/ELT processes, and implement data governance using Unity Catalog to power advanced analytics across the enterprise.

location: Phoenix, Arizona

job type: Contract

salary: $40 - 50 per hour

work hours: 8am to 5pm

education: Bachelors

responsibilities: Design, build, and maintain scalable batch and real-time data engineering pipelines using Databricks, PySpark, and SQL. Integrate Databricks seamlessly with Google Cloud Platform services including Google Cloud Storage (GCS), BigQuery, Pub/Sub, and Cloud Composer. Implement metadata-driven ingestion frameworks, incremental load patterns, and structured data models. Configure and manage Databricks Unity Catalog to enforce fine-grained access controls, security, and data lineage. Implement automated orchestrations using Cloud Composer/Apache Airflow and drive CI/CD DataOps best practices.

qualifications: 4+ years of hands-on data engineering experience building enterprise data pipelines with Databricks and PySpark. Strong experience with Google Cloud Platform cloud architecture and native services (GCS, BigQuery, Pub/Sub, Cloud Composer). Proven capability in data modeling, complex SQL development, and pipeline performance optimization. Practical experience configuring Databricks Unity Catalog, Delta Live Tables, and Auto Loader. Solid understanding of CI/CD deployment and DevOps workflows in cloud data environments.

PREFERRED QUALIFICATIONS Proficiency in Scala for Spark processing. Formal Google Cloud Platform or Databricks certifications (e.g., Databricks Certified Data Engineer Professional, Google Cloud Platform Professional Data Engineer). Experience with automated testing and DataOps frameworks.

Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status. At OpenKyber, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, OpenKyber offers a comprehensive benefits package, including: medical, prescription, dental, vision, AD&D, and life insurance offerings, short-term disability, and a 401K plan (all benefits are based on eligibility). This posting is open for thirty (30) days.

For applications and inquiries, contact:hirings@openkyber.com

Job Tags

Hourly pay, Contract work, Temporary work, Work experience placement

Similar Jobs

RJ Young

DPS Warehouse Associate Job at RJ Young

 ...Summary/Objectives The DPS Warehouse Associate is responsible for the daily operations of the DPS warehouse including but not limited to receiving customer products and supplies, labeling and assigning warehouse locations, picking, packing, and shipping customer orders... 

Veteran Air

HVAC Service Manager Job at Veteran Air

 ...HVAC Service ManagerAre you seeking a career advancement opportunity? An established home services company and a leader in South Florida is seeking a self-motivated HVAC Service Manager with a positive attitude to join our expanding and dedicated HVAC Team.Why join this... 

Confidential

Epic Senior Systems Analyst Job at Confidential

 ...OhioHealth is seeking an Epic Senior Systems Analyst to join our Information Technology team supporting our statewide healthcare network. In this role, you will lead the analysis, design, configuration, and optimization of Epic applications to enhance clinical and business... 

Progressive Roofing

Metal Commercial Roofer Job at Progressive Roofing

 ...Metal Commercial Roofer Progressive Roofing is growing and looking for the best of the best roofing professionals! Are you looking for year round work and growth opportunity? If the answer is yes, then we want to meet with you!! Skills/Qualifications needed... 

Carespring

Admission - MDS Nurse |LPN or RN Job at Carespring

 ...Come join our team as an admission/MDS nurse who assesses our new/existing patients to ensure all of the care needs are addressed and documented on the MDS. Pay Rate: LPN - $29 - $34 an hour based on licensure and experience! Pay Rate: RN - $35 - $42 an hour based...