Lead Data Engineer
Location: Chicago, IL
Job Type: Contract
Company: IDR
Category: Databases
Job Description Apply Now
The Lead Data Engineer role is a pivotal opportunity for experienced professionals specializing in advanced data and artificial intelligence (AI) solutions within the financial services industry. This position offers the chance to work remotely and collaborate with cross-functional teams to design, implement, and optimize sophisticated data architectures in a fast-paced banking environment. As a Lead Data Engineer, you will drive technical innovation and spearhead the adoption of emerging AI technologies, including generative AI (GenAI), to support the organization's strategic goals.
In this role, the Lead Data Engineer will function as a hands-on leader within an Agile development team, partnering closely with developers, stakeholders, and subject matter experts. The position requires a strong background in software and data engineering, particularly with tools such as PySpark and SQL Server. You will be tasked with developing complex user stories, delivering scalable technical solutions, and ensuring best practices in code quality and design. The Lead Data Engineer will also play an essential role in mentoring team members, conducting code reviews, and providing guidance on prompt engineering techniques to maximize the effectiveness of AI-driven applications.
This Lead Data Engineer role is well-suited for professionals who thrive in dynamic, innovative settings and are passionate about advancing data infrastructure and AI capabilities. The financial services sector is evolving rapidly, and this position presents a unique opportunity to make a tangible impact by integrating modern data methodologies and exploring the latest advancements in artificial intelligence. By joining this organization, you will benefit from a competitive compensation package, comprehensive benefits, and the support of a dedicated engagement manager focused on your professional development and success.
Working in this organization provides you access to a wealth of resources and a collaborative environment recognized for its commitment to client and talent satisfaction. With over two decades of proven industry experience and accolades such as the ClearlyRated’s Best of Staffing® Client and Talent Award, this team values excellence, innovation, and employee growth. The company offers programs such as an Employee Stock Ownership Program and comprehensive insurance benefits to enhance your career journey.
If you are a data engineering professional with advanced experience in PySpark and SQL Server, and you are eager to take on a leadership role that bridges technology and business objectives, this Lead Data Engineer position is an ideal next step. Take advantage of this opportunity to apply your expertise in a challenging and rewarding setting by clicking the job application button today.
Lead Data Engineer - Summary- Lead technical initiatives in data engineering and AI innovation within a financial services environment.
- Collaborate with Agile teams to design and implement advanced, scalable data solutions.
- Drive adoption of new AI and GenAI capabilities to enhance business applications.
- Serve as a hands-on lead engineer within Agile development teams, overseeing project execution and delivery.
- Partner with developers and stakeholders to design technical solutions aligned with business needs.
- Develop and implement complex user stories and technical solutions using PySpark and SQL Server.
- Conduct and support code reviews to maintain high standards of code quality and performance.
- Provide technical guidance and mentorship to team members, fostering skill development.
- Explore and implement advanced AI and GenAI capabilities tailored to the banking sector.
- Apply and promote best practices in prompt engineering and data architecture.
- Support the development of scalable, resilient data and application solutions.
- Competitive compensation package.
- Comprehensive benefits including medical, dental, vision, and life insurance.
- Employee Stock Ownership Program.
- Support from a dedicated engagement manager focused on your success.
- Recognition as a ClearlyRated’s Best of Staffing® Client and Talent Award winner.
- Extensive experience in engineering roles, ideally 6-9 years or more.
- Advanced proficiency in PySpark and SQL Server.
- Demonstrated hands-on experience in software/data engineering within Agile teams.
- Track record of designing and implementing complex technical solutions.
- Strong analytical and problem-solving abilities.
- Excellent communication skills for effective cross-functional collaboration.
- Experienced data engineer with a passion for AI and emerging technologies.
- Natural leader who enjoys mentoring team members and sharing technical expertise.
- Comfortable working in fast-paced, dynamic environments.
- Motivated to drive innovation and deliver impactful data solutions in the financial sector.
- This position is fully remote, offering flexibility and a collaborative digital workspace.
- The organization boasts over 25 years of experience and a commitment to employee growth and satisfaction.
- Applicants of all backgrounds are welcome and encouraged to apply.
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran. IDR is subject to certain governmental recordkeeping and reporting requirements for the administration of civil rights laws and regulations. In order to comply with these laws, we invite employees to voluntarily self-identify their race or ethnicity, gender, and veteran status (if applicable). Submission of this information is voluntary and refusal to provide it will not subject you to any adverse treatment. The information obtained will be kept confidential and may only be used in accordance with the provisions of applicable laws, executive orders, and regulations, including those that require the information to be summarized and reported to the federal government for civil rights enforcement. You may access this form here.
If you are ready to take your data engineering career to the next level and make a significant impact, apply now by clicking the application button and join a forward-thinking team dedicated to innovation and excellence in the financial services sector.