Data Engineer
Location: Rochester, MN
Job Type: Contract
Company: IDR
Category: Databases
Job Description Apply Now
Are you passionate about building robust data infrastructure and enabling data-driven decision-making? We are seeking a skilled Data Engineer to join our remote team. This Data Engineer position is an excellent opportunity for professionals who thrive on developing, optimizing, and maintaining scalable data pipelines and storage solutions. As a Data Engineer, you will play a crucial role in ensuring the reliability, integrity, and security of data that drives core business analytics and reporting functions. Your expertise in modern data engineering tools and best practices will be instrumental in empowering teams to access the right data at the right time, supporting impactful organizational decisions. If you have a background in designing data platforms, implementing data transformation processes, and supporting analytics tools, we encourage you to apply for the Data Engineer position and make a significant impact within a dynamic, innovative environment.
As a Data Engineer, you will leverage your proficiency in SQL, Python, and ETL/ELT processes to build and maintain reliable data architectures. You will have the opportunity to work with cutting-edge technologies such as Delta Lake, Medallion architecture, and leading analytics tools. Collaboration with cross-functional teams is at the heart of this role, ensuring that data flows seamlessly across platforms and that reporting needs are fully supported. In addition, your attention to data quality, governance, and security will help maintain the highest standards in data integrity and compliance. The remote work environment provides flexibility while allowing you to contribute meaningfully to projects that shape the organization's data strategy.
Data Engineer - Summary- Design, develop, and maintain robust data pipelines for organizational analytics and reporting.
- Build scalable, secure data storage solutions using industry-leading formats and platforms such as Delta Lake.
- Optimize data processes to ensure high performance and data integrity across a distributed environment.
- Collaborate with stakeholders to support business intelligence initiatives and reporting requirements.
- Champion best practices in data governance, security, and quality.
- Develop and optimize scalable data pipelines to ensure seamless data flow across multiple platforms.
- Construct and maintain modern data storage solutions, with a focus on technologies such as Delta Lake and Medallion architecture (Bronze/Silver/Gold layers).
- Implement data transformation processes to prepare datasets for analytics and reporting, facilitating data-driven decisions.
- Uphold data governance protocols, ensuring accurate data lineage, quality, and compliance with security standards.
- Collaborate with cross-functional teams to support analytics and reporting tools, including Power BI.
- Maintain and enforce security protocols, such as role-based access controls (RBAC), to safeguard sensitive organizational data.
- Monitor emerging data engineering trends and integrate best practices into the team’s workflows.
- Competitive compensation package reflecting the candidate’s experience and skill set.
- Comprehensive benefits, including medical, dental, vision, and life insurance.
- Employee Stock Ownership Program (ESOP) participation.
- Supportive work environment with opportunities for professional growth and development.
- Recognition for excellence, including industry awards for client and talent satisfaction.
- Bachelor’s degree in Computer Science, Engineering, or a related field; an associate’s degree with relevant experience may be considered.
- Significant professional experience in data engineering, including the design and management of large-scale data pipelines and platforms.
- Proficiency in SQL and Python for data processing, transformation, and automation.
- Hands-on experience with ETL/ELT development and data ingestion frameworks.
- Familiarity with modern data storage formats such as Delta Lake and knowledge of Medallion architecture models.
- Understanding of data transformation techniques, data lineage, and data quality management principles.
- Experience supporting analytics and reporting tools, preferably Power BI.
- Knowledge of data security practices, including implementation of role-based access controls (RBAC).
- Desirable: Experience with Microsoft Fabric, data catalog/lineage tools (e.g., Purview), CI/CD tools like Azure DevOps or Git, and exposure to real-time data streaming and ingestion.
- Analytical thinker with a passion for data engineering and continuous learning.
- Excellent communicator who thrives in collaborative, cross-functional settings.
- Detail-oriented and proactive in identifying and resolving data quality or security issues.
- Adaptable to evolving technologies and committed to staying current with industry trends.
- Dedicated to supporting organizational goals through data-driven solutions.
- As a Data Engineer, you will have the chance to work remotely, allowing for greater flexibility and work-life balance.
- The organization is committed to fostering an inclusive, supportive, and growth-oriented workplace.
- The company has a strong legacy of industry leadership, with over 25 years of experience and a track record of client and talent satisfaction.
- Employees are encouraged to take advantage of ongoing professional development and advancement opportunities.
- If you are ready to make a difference as a Data Engineer, click the apply button to begin your journey with us.
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran. IDR is subject to certain governmental recordkeeping and reporting requirements for the administration of civil rights laws and regulations. In order to comply with these laws, we invite employees to voluntarily self-identify their race or ethnicity, gender, and veteran status (if applicable). Submission of this information is voluntary and refusal to provide it will not subject you to any adverse treatment. The information obtained will be kept confidential and may only be used in accordance with the provisions of applicable laws, executive orders, and regulations, including those that require the information to be summarized and reported to the federal government for civil rights enforcement. You may access this form here.