Data Engineer



Software Engineering, Data Science
Remote · New York, NY, USA
Posted on Friday, December 15, 2023

Who Are We?

  • Our Mission: Increase government transparency to connect and empower. We're building the first "gateway" that helps businesses and individuals make sense of messy government data.
  • Why: Corporations, lobbyists, non-profits, and individuals alike are still using spreadsheets and archaic government websites to understand how bills impact their industry. They deserve a 21st century tool that streamlines how we make sense of pending legislation, and enables a more transparent and accessible lobbying process.
  • Investors: $3M+ seed led by WndrCo, Motivate Venture Capital, Amplify.LA, StageVP, Jarl Mohn (Founder of E! & Former CEO of MTV & NPR), Nick Allen (Founding Product Designer at Snapchat), and Hon. Tony Coelho (Former Congressman, US House Majority Whip, & Primary Sponsor of American Disabilities Act.
  • Customers: Include the California State Library, Bay Area Council, California Business Roundtable, Los Angeles County Business Federation, and California News Publishers Association.
  • Team: Passionate and hungry (both literally and figuratively), looking to build cool stuff to benefit everyone!
  • Where: HQ in SF, Abstract Engineering based in NYC.
  • Hybrid: We are a remote-first setup where working is predominantly done from home.


  • The role of Data Engineer at Abstract is one with many responsibilities over how unstructured data from all levels of government is collected, sanitized, structured, and scaled to ensure that customers receive insights in a timely manner.
  • Specifically, the goal of the person in this position is to manage the blueprinting, implementation, and architecture of Abstract’s data pipelines.
  • As the work expands to adding more services that collect local level and state-specific data among other things, the person in this position will be responsible for maintenance and optimization of this system, which includes any other services built to provide said data to the Abstract product.

Your Background

  • Experience with Python and its frameworks (3-5 years minimum)
  • Experience with ETL pipeline tools (Apache Spark, Apache Airflow, etc.): Previous experience (1+ years) in the aforementioned tools, or similar ones, ready to be used upon employment.
  • Experience working with the Elastic stack (ElasticSearch, Kibana, etc.)
  • Experience with Cloud Technologies: Experience working with AWS, GCP, or Azure.
  • Communication: You understand tricky topics, both in writing and in person. You communicate clearly and with precision.
  • Fast Learner: You quickly learn new concepts, and you easily pick up new skills.
  • Attention to Detail: You exercise astonishing attention for detail in everything that you do.
  • Inquisitive: You are curious about your customers, and want to understand their needs.
  • Determination: You love challenges, and persist when problems become complex.
  • Self-motivated: You are driven, and able to work autonomously in a fast-paced environment.
  • Passionate: You’re passionate about politics and/or government. 🇺🇲

Bonus Points

  • Previous experience building and maintaining scrapers at scale.
  • Well versed in legislative processes across local, state, or federal governments.
  • Solid understanding of Docker, Apache Airflow, and Serverless Architecture on AWS.


  • $140,000 - $160,000 Annual Salary
  • Favorable Equity

Perks and Benefits

Autonomy 🚀

  • Full autonomy in a high-growth startup.
  • Work with a small tight-knit team, passionate about making government more transparent and accessible via thoughtful design that is relied on by countless organizations for their daily work.

Generous Time Off 🏝

  • Unlimited PTO & Sick Leave
  • Paid Federal Holidays + Election Day 🇺🇲

Taking Care of Your Future 🙏

Available Health Insurance Policies

  • CCSB Kaiser Permanente Platinum HMO 0
  • CCSB Kaiser Permanente Gold HMO 250
  • CCSB Blue Shield Gold On-Exchange 350

401(k) with a Company Match

  • Our plan provides you an opportunity to defer compensation for your long-term savings (Pre-tax and Roth).
  • We will match up to 3.5% of your total eligible compensation.

We're an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status. At Abstract, we're cognizant of systemic issues in our industry that have created inequalities in opportunity for many communities. We acknowledge the fact that women and underrepresented minorities are hesitant to apply for a role they feel they don't check all the boxes for. Even if you don't check all the boxes in this posting, we highly encourage you to apply anyway! It would be our pleasure to get to know you and see if you're a fit for any of our teams.