Medallion Architecture

Once your data has arrived in its “Lakehouse”, Engineering provides a set of tools for Data Engineers to get the data cleaned, enriched, validated, and ready for live use. Its main tools are Opensource Apache “Spark” jobs, which can run many processes in parallel for big data applications, and which allow you to further refine…