ETL (Extract, Transform, Load) processes can involve considerable complexity to design, build and deploy. And once deployed, operational problems often occur which require significant care and feeding of ETL systems. For years ETL tools have been sold to CIOs and IT leaders on the premise that they will simplify this complex data movement process by providing a graphical user interface and other utilities to make development easier. Traditional ETL tools also come with the myth that they are somehow self-documenting, because they provide a “picture” of the ETL mapping. The reality for ETL developers and administrators is something very different.
Your ETL tool is failing you.