Data Engineer - Procom : Job Details

Title: Data Engineer

Location: Conshohocken, PA (Hybrid)

Type: Full-Time Direct Hire

Legal: US Citizen or Green Card Holder (No sponsorship available)

Compensation: Salary, bonus, and full benefits package

On behalf of our client, Procom is searching for a Data Engineer in Conshohocken, PA.

This is a full-time, direct-hire position with a competitive salary, bonus, and a comprehensive benefits package. Applicants must be U.S. Citizens or Green Card holders. Sponsorship is not available.

Job Summary

The Data Engineer plays a pivotal role in designing, developing, and maintaining scalable data pipelines and architectures using Microsoft Fabric, significantly contributing to the organization's data strategy. This position requires expertise in implementing ETL processes, optimizing workflows, and guiding data visualization tools like Power BI. The ideal candidate will have a strong understanding of data governance and security best practices and be proficient in programming languages such as Python, Java, or Scala.

As part of a collaborative team, the Data Engineer supports innovative solutions to drive strategic decision-making and operational success. This role also involves monitoring pipeline performance, troubleshooting issues, maintaining documentation, and staying ahead of industry trends.

Essential Duties

Data Pipeline and Architecture

• Design, develop, and maintain scalable data pipelines using Microsoft Fabric.
• Implement ETL processes to ensure data accuracy and availability.
• Optimize and tune data workflows for scalability and performance.

Visualization and Guidance

• Provide expertise in visualization tools, especially Power BI.
• Develop and enforce guidelines for effective dashboards and analytics.

Monitoring and Troubleshooting

• Monitor, identify, and resolve issues in data pipelines to ensure system reliability.

Documentation and Best Practices

• Create and maintain documentation for data processes, workflows, and architectures.
• Stay updated on best practices and trends in data engineering and Microsoft Fabric.

Additional Duties

• Take on tasks outside the outlined responsibilities to support organizational success.

Competencies

• Attention to Detail: Ensure meticulous accuracy in all tasks, from documentation to workflows.
• Business Acumen: Apply a deep understanding of business operations to improve efficiencies.
• Communication: Effectively convey complex ideas through written and verbal communication.
• Critical Thinking: Evaluate challenges to devise innovative and effective solutions.
• Presentation Skills: Develop and deliver compelling presentations to diverse audiences.
• Problem Solving: Approach complex problems with analytical and creative solutions.

Qualifications

Education & Experience:

• Bachelor's degree in Computer Science, Data Engineering, Statistics, Mathematics, or a related field.
• 5+ years of experience in data visualization, data mining, and analysis using Power BI.
• Expertise in Microsoft Fabric and cloud platforms like Azure.
• Proficiency in programming languages such as Python, Java, or Scala.
• Skilled in writing complex SQL queries and using Azure DevOps Git for version control.
• Experience creating data pipelines to transfer data from Lakehouse to warehouse tables in Microsoft Fabric.
• Knowledge of CI/CD pipelines, automation tools, and data governance/security best practices.