No matter how many reports and cubes you build you are always going to have users who need large extracts of raw data in CSV format. Typically this data is used for analysis using tools such as Tableau, R and MS Excel. In my experience large data extracts are done by an individuals part of…Continue readingThe Most Efficient Way to do Large SQL Data Extracts From Your BI Tool
Tag: etl
Categories
Syntactically better SQL CREATE statements
Debugging ETL SQL scripts can be frustrating because of the syntax used to create database objects. In this post I share some tips to write syntactically and functionally better SQL scripts that are particularly useful when using SQL for ETL. All syntax written for Sybase IQ 15.4. Historically to avoid object already exists type errors…Continue readingSyntactically better SQL CREATE statements
The first step when designing a fact table using Ralph Kimball’s dimensional modelling method is to decide on the grain of the table. Another way of describing the grain is the level of detail to store in your fact table. The accepted rule is that you should always store the data at the most detailed…Continue readingETL: Classify do not Filter out data