March 22, 2023

Ingesting and Processing Government Data with Merit's Charlie Summers

How to Subscribe
Share In

Merit’s verified identity platform brings visibility, liquidity, and trust to people-data, giving organizations the clarity to make better-informed decisions, engage with individuals effectively, and pursue their mission efficiently. Merit works with trusted private, state, and municipal organizations to solve critical real-world problems in sectors such as workforce development, emergency services, licensing, education, and defense readiness.

Merit ingests and processes highly sensitive data from a variety of government agencies. Privacy and security are of the utmost importance, but they must also balance data utility. To support customer and business needs, Merit uses a combination of off the shelf data stack tools and technologies along with off homegrown techniques around encryption and encryption key management.

Staff engineer and data tech lead, Charlie Summers, joins the show to breakdown Merit’s data stack, the life of data, the challenges they’ve faced with protecting sensitive data, and the ways they secure customer data.

Topics:

  • Can you talk about Merit and your role there?
  • What kind of data are you typically dealing with at Merit?
  • What’s your data stack?
  • Can you take me through the life of a piece of data?
  • What’s the scale of the data you’re working with? How big is this data set?
  • What challenges have you faced with securing sensitive data while using this stack?
  • What tools, technologies, or techniques are you using to protect the data?
  • How are you balancing the security of the data with the actual utility?
  • How do you control access to the data?
  • How does auditing work? Is every time the data touched logged in some way?
  • How did you think through build versus buy?
  • Why is privacy and security a priority for Merit?
  • What future technologies in this space are you particularly excited about?

Resources:

Other Podcast

September 11, 2024

Pseudo-anonymization of Data with Jack Godau

In this episode, Sean sat down with Jack Godau to dive deep into the world of pseudoanonymization. Jack shared how pseudoanonymization differs from anonymization, explaining its value for maintaining data utility while complying with stringent regulations like GDPR.

August 28, 2024

The Evolution of Certificate Management with Anchor Security's Ben Burkert

In this episode we explore how certificates and TLS function, the inherent difficulties in managing internal TLS certificates, and why nearly every engineer has a horror story related to it.

August 14, 2024

What is a Data Lakehouse with Upsolver's Ori Rafael

In this episode, we sit down with Ori Rafael, CEO and Co-founder of Upsolver, to explore the rise of the lakehouse architecture and its significance in modern data management.