This is a full-time direct hire role that requires being onsite 2 days a week in Baltimore, MD. The position includes full benefits.
Overview:
A Senior Data Engineer is responsible for building and optimizing data pipelines, designing, and maintaining scalable systems for data storage and processing. This role will collaborate closely with product leaders, software engineers, and integration teams to ensure the effective flow and accessibility of data, enabling data-driven decision-making across the organization.
Essential Functions:
- Data Pipeline Development: Design, build, and maintain scalable, efficient, and robust data pipelines to support the processing of large volumes of data.
- Data Integration: Integrate data from a variety of sources (e.g., relational databases, APIs, third-party datasets) into a unified and accessible format.
- Database Design & Management: Develop and maintain databases, data warehouses, and other data storage solutions to meet the organization's data needs and business goals.
- ETL/ELT Processes: Implement and manage Extract, Transform, Load (ETL/ELT) processes to ensure accurate and efficient movement of data between systems.
- Data Quality & Governance: Ensure high data quality and availability by implementing appropriate monitoring, testing, and validation techniques.
- Collaboration: Work closely with data integration engineers, business analysts, and software engineers to understand their data requirements and provide timely solutions.
- Automation: Automate manual data processes and workflows to improve efficiency and reduce errors.
- Data Security & Compliance: Ensure that all data solutions comply with data security, privacy, and regulatory requirements (e.g., GDPR, HIPAA).
- Performance Optimization: Continuously monitor the performance of data systems and make improvements to increase efficiency and scalability.
Required Qualifications:
- Bachelor's degree in Computer Science, Information Technology, or a related field
- Proven experience (3+ years) as a Data Architect, Data Engineer, or in a similar role
- Proficiency in database technologies (e.g., MySQL, PostgreSQL, SQL Server)
- Strong experience with data modeling, data warehousing, and ETL/ELT processes
- Familiarity with cloud data platforms (AWS, Azure, Google Cloud)
- Knowledge of data governance frameworks and data quality best practices
- Strong problem-solving skills and the ability to translate business needs into data architecture solutions
- Excellent communication and interpersonal skills