Howard Levenson, former regional vice president at Databricks, said government agencies looking to advance evidence-based decision-making in support of their missions should consider adopting open source-based technologies that could enable them to collect and analyze structured and unstructured data.
Levenson discussed how machine learning and an open source-based data lakehouse architecture like the Databricks Lakehouse Platform could help agencies perform predictive analytics using various forms of data, whether it is structured, semi-structured or unstructured.
âThe Databricks Lakehouse Platform combines the reliability, governance and performance of data warehouses with the openness, flexibility and machine learning support of data lakes,â he wrote.
Levenson talked about Databricksâ open format storage layer Delta Lake and Delta Sharing protocol and how they help organizations handle data.
He also cited how open source tools and predictive analytics could support agencies like the Department of Veterans Affairs and the U.S. Citizenship and Immigration Services in carrying out their work and advancing their missions.
