Big Data Engineer - RIT Solutions : Job Details

Big Data Engineer

RIT Solutions

Job Location : Atlanta,GA, USA

Posted on : 2024-11-16T14:32:20Z

Job Description :
Big Data Engineer Malvern, PA - Hybrid Job Description Responsibilities
  • Client's Strategy team leverages data, execution technology, and research to advance clinet's trading strategies, empowering traders to achieve the lowest trading costs, unmatched efficiency, and increased competitiveness.
  • As an Engineer on the full stack team, you will be expected to help design, implement, and maintain a modern, robust, and scalable platform which will enable the TAS team to meet the increasing demands from the various trading desks.
Qualifications:
  • Proficiency in Python programming Strong expertise in SQL, Presto, HIVE, and Spark
  • Experience in big data technologies such as Spark and developing distributed computing applications using PySpark
  • Experience with libraries for data manipulation and analysis, such as Pandas, Polars and NumPy
  • Understanding of data pipelines, ETL processes, and data warehousing concepts
  • Strong experience in building and orchestrating data pipelines
  • Experience in building APIs
  • Experience in designing and building web environments on AWS
  • Write, maintain, and execute automated unit tests using Python
  • Follow Test-Driven Development (TDD) practices in all stages of software development
  • Proficiency in data visualization tools and ability to create visual representations of data, particularly using Tableau
  • Extensive experience with key AWS services/components including EMR, Lambda, Glue ETL, Step Functions, S3, ECS, Kinesis, IAM, RDS PostgreSQL, Dynamodb, Timeseries database, CloudWatch Events/Event Bridge, Athena, SNS, SQS, and VPC
  • Proficiency in developing serverless architectures using AWS services
  • Experience with both relational and NoSQL databases
  • Skills in designing and implementing data models, including normalization, denormalization, and schema design
  • Knowledge of data warehousing solutions like Amazon Redshift
  • Strong analytical skills with the ability to troubleshoot data issues
  • Good understanding of source control, unit testing, test-driven development, and CI/CD
  • Ability to write clean, maintainable code and comprehend code written by others
  • Strong communication skills
  • Knowledge of trading and investment data
  • Experience with OneTick / KDB
Apply Now!
Similar Jobs ( 0)
-- View More Similar Jobs --