Sr Data Engineer (Python/Java) – FinTech Startup

0
911

Intelletec

Senior Data Engineer (Python OR Java)

Location: New York

Job Description

As a core contributor to the Platform Data Engineering team, your primary goals will be building pipelines that gather data from disparate sources, cleaning the data, and loading the transformed data into structures that are tailored to each client’s challenges and analytic approaches. You should have a solid understanding of how to access and extract data through various means (web services, web crawlers, direct access to source database, etc). You will create and apply custom solutions for data wrangling and develop semi-automated and automated ETL and database solutions.

Responsibilities

  • Contribute to the design and development of our Python data workflow management platform
  • Design and develop tools to wrangle datasets of small and large volumes of data into cleaned, normalized, and enriched datasets
  • Build and enhance the Data Engineering codebase for added efficiency and capacity
  • Refine processes for normalization and performance-tuning analytics

Qualifications

About You

  • You bring deep experience in the architecture and development of quality backend production systems, specifically in Python or Java
  • You are excited by the opportunity to solve challenging technical problems, and you find learning about data fascinating
  • You understand Server, Network, and Hosting Environments, RESTful and other common APIs, common data distribution, and hosted storage solutions

Must Have

  • 4+ years of full-time experience in a professional, production environment
  • Expertise in Python or Java
  • Experience with ETL and/or other big data processes
  • Proficiency in multiple programming languages

Even Better

  • Data skills: RDBMS SQL and NOSQL, structured and unstructured data, BigQuery
  • Proficiency in Jupyter, C24; familiarity with ETL, CDC, and workflow tools
  • Big data and cloud processing experience, e.g. HDFS, Spark
  • Experience working in a cloud-based environment, such as GCP or the AWS

For more information, please contact [email protected]

Read More…