Title: Data Engineer Department: Data AnalyticsReports To: Manager, Advanced Data AnalyticsSupervises: N/AJob Classification: Exempt, Full-time About Hope: HOPE (Hope Enterprise Corporation, Hope Credit Union and Hope Policy Institute) provides financial services; leverages resources; and engages in advocacy that strengthens the financial health and wealth of people in under-resourced Deep South communities. Since 1994, these efforts have benefitted more than three million people in Alabama, Arkansas, Louisiana, Mississippi and Tennessee, and influenced billions in persistent poverty communities across the nation. Learn more at www.hopecu.org.About the Job: HOPE is seeking a Data Engineer to join our growing team of data experts. The Data Engineer will be responsible for designing, developing, and maintaining robust data pipelines and architectures to support efficient data collection, processing, and analysis. This position is located in the Jackson, MS corporate office or available via telecommute within our five-state footprint, MS, LA, AR, AL, and TN. Occasional travel to the corporate office in Jackson, MS for in-person team meetings is required.Essential Job Functions:
- Data Integration: Integrate data from various sources, ensuring data consistency, quality, and reliability.
- Data Pipeline Development: Design, build, and maintain scalable data pipelines to support data warehousing, analytics, and reporting needs.
- Data Preparation and feature Engineering: Support with Data preparation and feature engineering for models.
- Performance Tuning: Optimize data processing and retrieval performance, ensuring efficient handling of large datasets.
- Spark and Databricks: Leverage Spark and Databricks for data processing and analytics.
- Data Governance: Utilize Azure Purview to ensure adherence to data governance policies and procedures, maintaining data quality and security standards.
- Data Quality: Develop and maintain Data Quality Assurance standards, pipelines, and reports for data in our environment
- Collaboration: Work closely with data scientists, analysts, and IT teams to understand data requirements and deliver effective data solutions.
Secondary Functions
- Technical Support: Provide technical support for data-related issues and troubleshoot problems as they arise.
- Documentation: Maintain comprehensive documentation of data processes, architectures, and workflows.
- Continuous Improvement: Stay current with industry trends and best practices, recommending improvements to existing processes and technologies.
Required Qualifications
- Bachelor's degree (or higher) in Computer Science, Engineering, or a related discipline.
- 6+ years of experience in data engineering or a related field
- Travel up to 25%
Preferred Qualifications:
- Technical Proficiency: Strong proficiency in SQL and experience with Python, R, Java, or Scala is required.
- Azure Tools: Experience with the Azure Data Engineering tools including; Azure Synapse, Azure Data Factory (ADF), and Azure Data Lake Storage (ADLS) Gen 2 and Purview is required
- Spark and Databricks: Experience with Spark/PySpark/SparkR and Databricks for data processing and analytics is required
Competencies/Skills
- Data Visualization tools: Experience with Power BI or Tableau is required
- Data Modeling: Knowledge of data modeling techniques and best practices.
- Data Integration: Experience with data integration tools and techniques.
- Problem-Solving: Excellent problem-solving and analytical skills, with attention to detail.
- GCP Tools: Familiarity with the Google Cloud ecosystem is an added advantage.
- Communication: Strong interpersonal and communication skills, capable of collaborating effectively with cross-functional teams.
- Organizational Skills: Ability to manage multiple projects and tasks simultaneously.
- Project Management: Experience with project management methodologies and tools.
- Organizational Awareness: Having and using knowledge of systems, situations, procedures, and culture inside the organization to identify potential problems and opportunities; perceiving the impact and the implications of decisions on other components of the organization.
- Results Orientation: Being persistent and showing perseverance on achieving concrete and tangible results out of personal responsibility; getting optimum results from situations and being ready to take action and show tenacity in case of obstacles or resistance.
Regulatory Compliance Requirements
- Must comply with provisions of the Bank Secrecy Act (BSA).
- Must comply with all provisions of the Privacy of Consumer Financial Information regulations.
- Must comply with all provisions of the Right to Financial Privacy Act.
Specified Authority Level
- Access to CFO paper and computer files.
- The Data Engineer will be granted systems administrator permissions to appropriate software systems by the Information Security Officer.
Physical Demands
- The employee is regularly required to sit, stand, and walk.
- The employee will use hands to finger, handle, or feel, reach with hands and arms, and talk or hear.
- Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.
Work Environment
- Under normal circumstances, an employee spends most of their time in an office environment, accessible to the public, customers, and potential customers. Employees who telecommute must have access to a quiet environment suitable for professional work, high-speed internet capability, and be able to participate in video conference sessions. If a non-essential employee wishes to work at a HOPE location, he/she must conform to work, and safety requirements implemented by the Human Assets Department.
- Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.Equal Opportunity Employer/Protected Veterans/Individuals with DisabilitiesThe contractor will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with the contractor's legal duty to furnish information. 41 CFR 60-1.35(c)