Employment Services

We help you find the correct IT placement

Data and Integration Engineer

Maryland Heights, MO 63043

Posted: 04/05/2019 Employment Type: Contract Job Category: Database Technologies Job Number: 12327

Adaptive Solutions Group is a premier provider of information technology personnel. We provide a variety of technical professionals available for contract, contract to hire, or direct placement positions to companies in and around the Kansas City, St. Louis, Denver, and Dallas Areas.

 

We are currently looking for a Data and Integration Engineer  to join our team.

 

Essential Functions
  • Daily monitoring of database storage allocation and usage as well as other resource usage.
  • Assists with backup standards and schedules and recovery procedures.
  • Security plan development, testing and maintenance.
  • Intent of this security plan is to establish a means of providing complete accountability for any and all use of the databases.
  • Provides performance turning related to indexing, stored procedures, triggers and database/server configuration.
  • Provides Technical guidance to teammates.
  • Excellent communication and Presentation Skills
  • Design and build data processing pipelines for structured and unstructured data using tools and frameworks in the Hadoop ecosystem.
  • Implement and configure tools for Hadoop-based data lake implementations and Proof of concepts.
  • Solid software engineer with excellent analytical and troubleshooting skills.

 

Job Responsibilities
  • Work closely with Analysts to develop and implement data transformations within data lake systems, both on-prem and in the AWS environment.
  • Develop and/or consume web services for data integration and ingestion of source data.
  • Create and maintain workflows with an emphasis on reusability, scalability, optimization and parameterization in a variety of platforms.
  • Responsible for understanding RDBMS and big data concepts and connectivity to various data sources and platforms.
  • Develop detailed flow charts detailing data lineage across ingestion and transformation of data as needed.
  • Analyze and document data from different platforms/products and determine appropriate transformations to standardize and potentially combine into a single destination.
  • Document and develop pipelines that preserve a data dictionary and maintain/save appropriate metadata.
  • Perform analysis on projects and provide project plans down to the task level and include time estimates for each task.
  • Provide status reports that give a detailed description of the current project’ s progress and indicate time devoted to each task.
  • Analyze data as needed in various data environments, including but not limited to Oracle, SQL Server, Hadoop/Hive, RedShift and more.

 

Required Qualifications
  • Ability to Design and develop extremely efficient and reliable data pipelines to move terabytes of data into the Data Lake and other landing zones.
  • Use expert coding skills in Hive H-SQL, T-SQL, PL/SQL.
  • Develop and implement data auditing strategies and processes to ensure data accuracy and integrity.
  • Mentor and teach others.
  • Solid Linux skills.
  • At least 2-3 years of real-time experience with AWS.
  • Experience with a wide variety of tools, including Attunity products, DMS, and SnapLogic is a plus.

 

Adaptive Solutions Group offers a competitive compensation and benefits package that includes medical, dental, STD/LTD, life insurance coverage, 401k, paid vacation and holidays.

Adaptive Solutions Group is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, and veteran or disability status.

Nick Bilpush

Send an email reminder to:

Share This Job:

Related Jobs:

Login to save this search and get notified of similar positions.