Author: polaris

Created with Sketch.

Data Preparation and Continuous Integration

After creating a nice dataflow, you’ll probably want to reuse the dataflow against another file or query result automatically (like daily-basis) or manually. Metatron Discovery’s data swapping feature is developed to enable this kind of works. Although Metatron Discovery itself doesn’t have scheduling ability, but you can use preptool, a CLI tool for data preparation…
Read more

Deploying Metatron with the Fully Engineered Docker Image

Metatron Discovery is a very useful BI solution that contains from data preparation to end-user visualization, but because of that wide coverage, the required components are rather more than other independent solutions, so installation, configurations could be very tiresome. Supporting clients of ours, I felt that if we could deploy as a docker image at…
Read more

Using Apache Spark in Data Preparation

Recently, Discovery Spark Engine has been introduced in Metatron Discovery. It is an external ETL engine based on Spark SQL. The embedded engine suffers huge garbage collection pressure if the record count reaches more than 1M. In this case, Discovery Spark Engine is the best solution. To avoid complex dependency problems, Discovery Spark Engine is…
Read more

Metatron at AWS re:invent 2019

AWS re:Invent 2019 kicks off in Las Vegas next week! Every year, AWS re:Invent introduces AWS emerging technologies, including databases, analytics and big data, security and compliance, enterprise, machine learning. Meet with our experts at the SK telecom booth at 2002 to learn more about Metatron! SK telecom Metatron Booth #2002 Date: December 02-06, 2019 Location:…
Read more