Databricks Technical Lead
About the Job
Gentis Solutions is looking for a Databricks Technical Lead to join our team. This role is part of our Professional Consultants group, working directly with clients to accomplish their goals. The client has expressed an interest in hiring the individual after project completion. Consulting engagements of this type typically last an average of 3-6 months.
Compensation for this position ranges from 156k/year - 177k/year per year, based on experience. Payment is bi-weekly and is based on all hours worked, without eligibility for overtime.
This position requires the individual to be located in the , area.
Job Summary:
We are seeking a seasoned Databricks Technical Lead to join our HR Systems Engineering team. This role is pivotal in enhancing the experience of over 420,000 associates by leading the design, build, and optimization of our data platform, services, APIs, and cloud migrations.
As a product-centric role within an agile delivery framework, you will ensure our data solutions align with business objectives and deliver tangible value. Join us in an organization recognized as one of the best places to work in IT for seven consecutive years.
Required Qualifications:
• 10+ years of experience in data engineering, big data, or API development, with at least 3+ years in a leadership role.
• Proven experience leading product-centric data engineering initiatives in an agile delivery environment.
• Expertise in Azure Databricks, Apache Spark, Azure SQL, and other Microsoft Azure services.
• Strong programming skills in Python, Scala, and SQL for data processing and API development.
• Experience in building and managing APIs (REST, GraphQL, gRPC) and microservices.
• Hands-on experience with Azure Data Factory (ADF), Azure Synapse Analytics, and Delta Lake.
• Proficiency in CI/CD pipelines, Terraform/Bicep, and Infrastructure-as-Code.
• Experience with data security and compliance measures (e.g., encryption, access control, auditing) for sensitive HR and employee data.
• Strong problem-solving skills, with a focus on performance tuning, security, and cost optimization.
• Experience with containerization (Docker, Kubernetes) and event-driven architecture is a plus.
• Exposure to Informatica for ETL/ELT and data integration.
• Excellent communication and leadership skills in a fast-paced environment.
• This is a contract-to-hire position, and candidates must be prepared to transition to a full-time employee role.
Preferred Qualifications:
• Microsoft Certified: Azure Solutions Architect Expert or Databricks Certified Data Engineer/Architect certification.
• Experience with agile development methodologies such as Scrum or SAFe.
• Familiarity with machine learning workflows in Azure Databricks.
• Knowledge of Azure API Management and Event Hub for API integration.
• Experience with Informatica PowerCenter or Informatica Intelligent Cloud Services (IICS).
• Hands-on experience with Oracle HCM database models and APIs, including integrating this data into enterprise data solutions
• Experience with HR Analytics.