Sr Data Engineer (Python/Java) – FinTech Startup

    By
    Staff
    -
    0
    835

    Intelletec

    Senior Data Engineer (Python OR Java)

    Location: New York

    Job Description

    As a core contributor to the Platform Data Engineering team, your primary goals will be building pipelines that gather data from disparate sources, cleaning the data, and loading the transformed data into structures that are tailored to each client’s challenges and analytic approaches. You should have a solid understanding of how to access and extract data through various means (web services, web crawlers, direct access to source database, etc). You will create and apply custom solutions for data wrangling and develop semi-automated and automated ETL and database solutions.

    Responsibilities

    • Contribute to the design and development of our Python data workflow management platform
    • Design and develop tools to wrangle datasets of small and large volumes of data into cleaned, normalized, and enriched datasets
    • Build and enhance the Data Engineering codebase for added efficiency and capacity
    • Refine processes for normalization and performance-tuning analytics

    Qualifications

    About You

    • You bring deep experience in the architecture and development of quality backend production systems, specifically in Python or Java
    • You are excited by the opportunity to solve challenging technical problems, and you find learning about data fascinating
    • You understand Server, Network, and Hosting Environments, RESTful and other common APIs, common data distribution, and hosted storage solutions

    Must Have

    • 4+ years of full-time experience in a professional, production environment
    • Expertise in Python or Java
    • Experience with ETL and/or other big data processes
    • Proficiency in multiple programming languages

    Even Better

    • Data skills: RDBMS SQL and NOSQL, structured and unstructured data, BigQuery
    • Proficiency in Jupyter, C24; familiarity with ETL, CDC, and workflow tools
    • Big data and cloud processing experience, e.g. HDFS, Spark
    • Experience working in a cloud-based environment, such as GCP or the AWS

    For more information, please contact aria@intelletec.com

    Read More…