Employment Services

We help you find the correct IT placement

Lead Data Engineer

Lenexa, KS 66219

Posted: 11/07/2024 Employment Type: Direct Placement Job Category: Database Technologies Job Number: 16810

Job Description


Adaptive Solutions Group is a premier provider of information technology personnel. We provide a variety of technical professionals available for contract, contract to hire, or direct placement positions to companies in and around the Kansas City and St. Louis areas.

We are currently looking for a Lead Data Engineer to join our team.


Responsibilities
  • Work closely with Product Manager and business stakeholders and develop a strong business understanding of strategic and project level data needs.
  • Work with Product Owners to understand and translate business requirements into technical specifications and logical & physical data model requirements.
  • Design and extend data models working closely with Product and Data Architecture.
  • Design data pipelines that process both real time and batch data leveraging modern data engineering best practices.
  • Build, implement and test data pipelines using Databricks, Azure Data Factory, SSIS and other data integration tools.
  • Take technical ownership of projects and ensure deliverables meet scope, quality and timelines.
  • Provide technical leadership and guidance to the data engineering team, including mentoring, coaching, and fostering a collaborative work environment between all team members.
  • Support team members with troubleshooting and resolving complex technical issues and challenges.
  • Implement coding standards, conduct code reviews to ensure proper code quality level.
  • Implement effective source code management and CI/CD best practices to ensure data pipelines are automatically tested, integrated and deployed to production.
  • Partner with Data Architects to implement effective data integration and storage design patterns. Contribute to continously improve existing data architecture and frameworks.
  • Assist in the development and implementation of data governance and management solutions.
  • Stay abreast with evolution of cloud Data technologies, frameworks, and best practices to continuously evolve  Data platform and solutions.
  • Promotes honest and open communication
  • Demonstrate behaviors that are consistent with the values, philosophies, and leadership characteristics.

Required Qualifications
  • Bachelor’s Degree or higher in Computer Science, Engineering, or related field required.
  • 10+ years of experience in data engineering and data warehousing.
  • 5+ years of cloud data engineering and big data experience .
  • Experience with cloud data engineering and data warehouse technologies in Microsoft Azure, Google or AWS. Experience in Azure is highly preferred.
  • Strong programming skills in python and SQL for data processing and automation.
  • Strong technical skills in big data and Data integration technologies including Spark, Kafka, Databricks, Azure Data Factory, SSIS and SQL.
  • Experience with designing and building both cloud and on-prem data warehouses. Experience with Lake house architecture is highly preferred.
  • Experience in data modeling for transactional and analytical needs. Experience with NoSQL databases is preferred.
  • Development experience in Microsoft SQLServer including experience with tuning queries to optimize performance.
  • Skilled in Visual Studio with the use of source control applications such as Azure DevOps.
  • Experience with CI/CD and Jenkins.
  • In-depth knowledge of data management principles and best practices, including data governance, data security, data quality, and data integration.
  • Experience with delivering data solutions iteratively using the Agile Scrum framework and development processes.
  • Experience in providing guidance, mentorship, and technical support to a team of data engineers.
  • Demonstrated ability to troubleshoot and resolve complex technical issues related to data processing in a cloud big data infrastructure.
  • Exceptional analytical and conceptual thinking skills coupled with strong written and verbal communication skills.
  • Excellent interpersonal skills, with the ability to effectively collaborate with cross-functional teams, stakeholders, and senior management.
  • Able to communicate effectively, both written and orally, with internal and external customers, vendors, and partners.
  • Ability to interact effectively with co-workers to accomplish daily tasks and to resolve interpersonal conflicts and miscommunications.
  • Thrives in ambiguous technology situations.

Preferred Qualifications
  • Financial industry knowledge.
  • Development experience with Power BI and SSRS/Power BI Paginated reports.


Adaptive Solutions Group offers competitive compensation and benefits package that includes medical, dental, STD/LTD, life insurance coverage, 401k, paid vacation and holidays.

Adaptive Solutions Group is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, and veteran or disability status.

Job Requirements

Lead

Meet Your Recruiter

Send an email reminder to:

Share This Job:

Related Jobs:

Login to save this search and get notified of similar positions.

About Lenexa, KS

Join us in the vibrant job market around Lenexa, Kansas! This thriving area offers a perfect blend of career opportunities and quality of life. Located in the heart of Johnson County, Lenexa boasts a friendly community, excellent schools, and a variety of dining options ranging from BBQ joints to food trucks. Enjoy outdoor adventures at Shawnee Mission Park or catch a show at the Theatre in the Park. With close proximity to Kansas City's renowned art galleries, professional sports teams like the Kansas City Chiefs and Royals, and iconic venues like the historic Kauffman Center for the Performing Arts, Lenexa is the ideal place to grow your career while embracing a unique culture and irresistible charm. Explore our job listings today and discover the exciting possibilities this region has in store for you!