AI Engineer – Databricks
Location: Englewood, CO
Job Type: Contract
Company: IDR
Category: DevOps
Job Description Apply Now
AI Engineer – Databricks
If you are looking to make an impact in the field of artificial intelligence and large-scale data engineering, the opportunity to join a dynamic organization as an AI Engineer – Databricks may be the next step in your career. This full-time position is designed for professionals eager to lead technical onboarding and platform operations for enterprise-level AI and data engineering initiatives on cloud-based platforms. The role is ideal for those passionate about advancing AI capabilities, implementing robust data governance, and working within highly regulated industry environments.
The AI Engineer – Databricks will spearhead efforts to onboard users, teams, and data domains onto a centralized Databricks platform hosted on AWS. In this capacity, you will address complex challenges such as integrating external data sources, establishing effective governance frameworks, deploying Databricks-native AI solutions, and ensuring efficient cost attribution. The position emphasizes hands-on technical leadership, requiring deep expertise in Databricks, data engineering, and AI/ML platforms. Collaboration with cross-functional teams to guarantee platform reliability, scalability, and compliance will be a cornerstone of your work.
As an AI Engineer – Databricks, you will be responsible for setting technical standards, mentoring junior engineers, and managing critical integration tasks to enable seamless access to external data and AI features at an enterprise scale. Your technical acumen in Databricks administration, including Unity Catalog, Delta Lake, cluster management, and job orchestration, will be pivotal in advancing the organization’s data strategy. You will leverage advanced skills in Python, SQL, and PySpark to design and optimize production-grade data pipelines, while utilizing CI/CD best practices for Databricks deployments with tools like Terraform, Asset Bundles, or GitLab.
This career opportunity comes with a competitive compensation package, comprehensive benefits, and the chance to contribute significantly to an industry-leading organization. You will be part of a company recognized for its commitment to employee success, offering valuable resources such as an Employee Stock Ownership Program, dedicated engagement management, and a proven track record in the staffing industry.
Working as an AI Engineer – Databricks provides the unique advantage of collaborating with a forward-thinking team and accessing advanced technology in a supportive environment. If you are motivated by the prospect of driving data and AI innovation and want to be part of a company with a strong presence and award-winning reputation, consider applying for this exciting role by clicking the job application button.
AI Engineer – Databricks Summary- Lead technical onboarding and platform operations for enterprise AI and data engineering initiatives on cloud-based Databricks environments.
- Work hands-on to solve complex integration, governance, and deployment challenges at scale.
- Set technical standards, mentor junior engineers, and manage platform integration tasks.
- Collaborate to ensure platform scalability, reliability, and data governance compliance.
- Oversee onboarding of users, teams, and data domains onto the Databricks platform hosted on AWS.
- Resolve challenges associated with integrating external data sources, enforcing governance policies, deploying AI solutions, and managing cost attribution.
- Establish and maintain technical best practices for Databricks and data engineering workflows.
- Mentor junior team members and provide guidance on technical issues and platform integration.
- Act as a hands-on leader, supporting development and optimization of production data pipelines using Python, SQL, and PySpark.
- Collaborate with cross-functional teams to ensure platform efficiency, reliability, and compliance with industry regulations.
- Administer Databricks at scale, including Unity Catalog, Delta Lake, cluster management, and orchestrating jobs.
- Competitive compensation package.
- Comprehensive benefits including Medical, Dental, Vision, and Life Insurance.
- Employee Stock Ownership Program.
- Access to a dedicated engagement manager focused on your success.
- Opportunity to join an award-winning organization recognized for excellence in staffing services.
- Bachelor’s degree in Computer Science, Information Systems, Data Engineering, or a related field, or equivalent practical experience.
- 5+ years of experience in data engineering, platform engineering, or cloud data roles.
- Minimum 3 years managing Databricks in a production environment.
- Advanced knowledge of Databricks administration at scale, including Unity Catalog, Delta Lake, cluster management, and job orchestration.
- Proficiency in CI/CD processes for Databricks deployments using Terraform, Asset Bundles, or GitLab.
- Expertise in Python, SQL, and PySpark for reliable, production-grade data pipeline development.
- Demonstrates strong technical leadership and problem-solving skills in enterprise cloud data environments.
- Thrives on hands-on work and taking ownership of platform integration and optimization initiatives.
- Experienced in mentoring and collaborating with diverse teams for platform reliability and governance.
- Excels in highly regulated industries and enjoys the challenge of large-scale data governance and AI deployment.
- Values ongoing professional development and contributing to a high-performing, award-winning organization.
- Join a respected organization with over 25 years of industry experience.
- Work in an environment recognized for its commitment to both clients and talent, including multiple industry awards.
- All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
- IDR is subject to governmental recordkeeping and reporting requirements for civil rights laws; voluntary self-identification information will be kept confidential and used only as permitted by law.
If you’re ready to advance your career as an AI Engineer – Databricks, click the application button to submit your resume today and become part of a forward-thinking team driving innovation in AI and data engineering.