Loading...
USM Jobs / Lead Data Engineer
Medium Contract

JB060382 - Lead Data Engineer Apply

  • Start Date:
    Interview Types
  • Skills AWS(EMR/Glue, S3, La..
    Visa Types Green Card, US Citiz..
Top Skills' Details
Discover's historical credit card data will be in the Capital One ecosystem in OneStream's OneLake location and these Engineering teams will be responsible for picking the data up, transforming and loading into target state, which could be Snowflake or AWS S3
 
6 Tech Leads to lead 6 separate Data Engineering teams (Capital One formers preferred)
Tech Leads are accountable for team's work being delivered on time, will lead sprint ceremonies for team, accountable for problem solving with senior managers, must be able to pivot and adapt quickly based on requirements, incredibly high caliber talent needed in tech leads
 
 
Must Have
• AWS(EMR/Glue, S3, Lambda, Cloudwatch), Python/Java, Spark, Databricks, SQL, Bash)
• Python use: scripting, building new data pipelines (not app dev)
Data warehousing experience (Snowflake)
• APIs
• Agile engineering practices & JIRA usage
 
Nice to Have
- Kafka, Airflow, Open Table formats (Delta, Hudi, Iceberg), Splunk, NewRelic, Github, Jenkins, prior Capital One experience highly preferred
 
Must be located in Capital One core locations (listed in order of preference)
- Chicago
- McLean
- Richmond
- Plano
 
Secondary Skills - Nice to Haves
Kafka
airflow
 
• Agile engineering practices & JIRA usage
 
Nice to Have
- Kafka, Airflow, Open Table formats (Delta, Hudi, Iceberg), Splunk, NewRelic, Github, Jenkins