Extract, load and transform, or ELT, is a data integration process that moves data directly from source to destination for analysts to transform as needed.
Apache Spark has become a popular platform as it can serve all of data engineering, data exploration, and machine learning use cases. However, Spark still requires the on-premises way of managing clusters and tuning infrastructure for each job.
Sometimes it takes a billion-dollar mistake to bring the murkier side of data ethics into sharp focus. Equifax found this out to their own cost in 2017 when they failed to protect the data of almost 150 million users globally. The catastrophic breach was bad enough on its own — but Equifax waited three months to go public with the news. As the public furore rose to a crescendo, the credit organization dragged its feet on disclosing exactly what kind of information had been leaked.
A lot can happen in 18 months. In a startup, that’s even more true. Here at ThoughtSpot, where we’re known for innovation at a breakneck pace, that feels like a lifetime.