Data Engineer - ConsultNet : Job Details

Data Engineer Overview We are seeking a skilled professional to design, build, and maintain the infrastructure required for large-scale data collection, storage, and analysis. The role involves collaborating with cross-functional teams to develop data systems that support key data pipelines and business objectives.

Key Responsibilities

Data Infrastructure & Pipeline Development

• Design, implement, and maintain scalable systems for data management.
• Build and optimize ETL pipelines for seamless data processing.
• Ensure high performance and reliability in data storage and retrieval.

Data Warehousing

• Develop and enhance data warehouse structures to support various data formats.
• Apply techniques like partitioning and indexing to improve query performance.

Database Management

• Create and manage database schemas for efficient data handling.
• Leverage SQL and NoSQL technologies to implement robust database solutions.
• Uphold data quality, security, and integrity standards.

Data Integration

• Consolidate data from multiple sources into unified storage systems.
• Work with APIs and collaborate with engineering teams to integrate data workflows.

Data Modeling & Transformation

• Utilize best practices in data modeling to ensure consistency and accuracy.
• Perform data cleansing, enrichment, and transformation as needed.

Governance & Compliance

• Adhere to data governance policies and implement quality assurance measures.
• Document processes and maintain up-to-date architectural records.

Collaboration & Support

• Partner with analysts and stakeholders to address data requirements.
• Provide troubleshooting and mentorship to team members.

Application Integration

• Facilitate data exchange between business applications and storage systems.
• Develop APIs and middleware solutions for seamless integration.

Performance Optimization

• Monitor system performance to identify and resolve bottlenecks.
• Continuously improve scalability and cost-efficiency of data systems.

Qualifications

Education & Experience

• Bachelor's degree in a technical field or equivalent professional experience.
• Hands-on experience in data engineering, warehousing, and ETL processes.
• Familiarity with cloud platforms (AWS, Azure, Google Cloud) and related tools.
• Experience with Snowflake, Synapse, Azure Data Factory, or similar platforms preferred.

Technical Skills

• Proficient in SQL and NoSQL database management.
• Expertise in programming languages such as Python, Java, or Scala.
• Knowledge of big data frameworks (e.g., Spark, Hadoop) and data automation tools.

Certifications

• Certifications like Azure Data Engineer Associate or similar are a plus.

Skills & Abilities

• Strong analytical, problem-solving, and communication skills.
• Ability to learn and adapt to new technologies quickly.
• Experience with formal software development processes preferred.
• Capability to work independently and as part of a team.

Physical Requirements

• Prolonged periods of sitting and computer use.
• Regular attendance and ability to perform repetitive motions.
• Occasional bending, stooping, and reaching.

Welcome to ConsultNet and the family of companies, Tekne, SaltClick, TechBridge, and OmniMedia. As a premier national provider of technology talent and solutions, our expertise spans across project services, contract-to-hire, direct placement, and managed services both onshore and nearshore. Celebrating more than 25 years of partnership with a diverse client base, we've crafted rewarding opportunities for our consultants, fostering high-performing teams that deliver impactful results.

Over the last few years thousands of consultants have found their calling with us in roles that have made a meaningful impact on their lives, enhanced their career, challenged them, and propelled them towards achieving their personal and professional goals. At the ConsultNet family of companies, we believe effective communication is crucial in aligning the right job with your unique skills and professional aspirations. To us, it's all about the personal approach we take and the values we uphold.

Our comprehensive service offerings cover a wide range of technology positions across key markets nationwide. Client more at www.consultnet.com .

We champion equality and inclusivity, proudly supporting an Equal Opportunity Employer policy. We welcome applicants regardless of Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other status protected by law.