Data Engineer
Location: Atlanta, GA
Job Type: Contract
Company: IDR
Category: Network Engineering
Job Description Apply Now
The Data Engineer plays a critical role in supporting the ongoing modernization of data systems, infrastructure, and analytics for a leading organization in Atlanta. This full-time contract position offers an exciting opportunity to work at the forefront of data engineering, leveraging advanced tools and technologies in a collaborative, team-focused environment. As a Data Engineer, you will drive the development and optimization of data pipelines, contribute to effective data modeling, and deliver robust data solutions that power key business insights and strategic decisions. If you are passionate about building scalable data architectures and partnering with cross-functional teams to deliver high-quality, actionable data, this is a compelling opportunity to advance your career. Join a workplace that values innovation, growth, and collaboration by submitting your application through our job portal today!
Data Engineer - SummaryThe Data Engineer is responsible for designing, building, and maintaining sophisticated data pipelines and architectures using industry-leading tools such as Microsoft Fabric and Azure Databricks. The position focuses on implementing best practices in data management, supporting the transition from legacy systems, and ensuring continuous data quality and availability. This role is essential for delivering curated datasets and analytics models that drive advanced reporting and visualization, particularly using Power BI. As a Data Engineer, you will work closely with analysts, stewards, and business stakeholders to ensure that data solutions are tailored to organizational needs and meet governance standards.
Duties & Responsibilities- Design and develop scalable ETL/ELT data pipelines utilizing Microsoft Fabric and Azure Databricks to support data ingestion, processing, and transformation.
- Implement medallion architecture to optimize data lifecycle management and maintain high standards of data quality.
- Lead efforts to sunset legacy SQL-based infrastructure and SSRS, ensuring seamless data continuity and preparing stakeholders for new systems.
- Create and manage notebooks for data transformation using Python, SQL, and Spark, supporting robust analytics and reporting needs.
- Build and deliver curated datasets and analytics models for Power BI dashboards and reports, enabling actionable business intelligence.
- Collaborate with data analysts, stewards, and business stakeholders to deliver fit-for-purpose data assets that align with business objectives.
- Support data governance initiatives by integrating tools such as Microsoft Purview and Unity Catalog into data management workflows.
- Competitive compensation package designed to attract top talent in the industry.
- Comprehensive benefits including medical, vision, and dental insurance.
- Access to an Employee Stock Ownership Program, providing opportunities for long-term financial growth.
- Additional benefits such as life insurance and other wellness options.
- Opportunity to work within an organization recognized for its industry leadership and award-winning workplace culture.
- Bachelor's degree in Computer Science, Information Systems, or a related field is required.
- Minimum of 5 years of experience in data engineering or a similar technical role, ideally in government or regulated environments.
- Expertise in SQL, Python, and Spark for data processing and transformation tasks.
- Demonstrated hands-on experience with Microsoft Fabric, including Dataflows, Pipelines, Notebooks, and OneLake.
- Solid background in Power BI data modeling and dashboard development.
- Familiarity with data governance tools such as Microsoft Purview and Unity Catalog.
- Highly skilled in modern data engineering practices and cloud-based data platforms.
- Proactive problem-solver who is comfortable leading modernization initiatives and sunsetting outdated systems.
- Collaborative team player with excellent communication skills, able to engage with technical and non-technical stakeholders.
- Detail-oriented and committed to maintaining data accuracy, quality, and compliance with governance standards.
- Motivated to contribute to a positive organizational culture and to drive impactful business outcomes through data.
- This full-time contract position is set to renew annually, providing stability and ongoing opportunities for professional growth.
- The organization has a proven track record of success, with over 25 years of industry experience and recognition as a Best of Staffing® Client and Talent Award winner for 12 consecutive years.
- Enjoy the benefits of working in Atlanta, a dynamic city known for its vibrant tech community and abundant professional opportunities.
- The company fosters a close-knit, team-oriented culture where employees can thrive and grow in their careers.
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran. IDR is subject to certain governmental recordkeeping and reporting requirements for the administration of civil rights laws and regulations. In order to comply with these laws, we invite employees to voluntarily self-identify their race or ethnicity, gender, and veteran status (if applicable). Submission of this information is voluntary and refusal to provide it will not subject you to any adverse treatment. The information obtained will be kept confidential and may only be used in accordance with the provisions of applicable laws, executive orders, and regulations, including those that require the information to be summarized and reported to the federal government for civil rights enforcement. You may access this form here.
Take the next step in your data engineering career by clicking the application button to submit your resume and join a forward-thinking organization dedicated to innovation and excellence.