Our Services
We offer ETL/ELT solutions for various sized data warehouses and/or marts which can be optimized for your reporting and analytics needs. Streamline your business operations with seamless integration of different systems ranging from COTS products to custom solutions. We provide the architecture, planning and implementation of the applications and configurations needed to meet our customer use cases.
Excel solutions with features that utilize functions, formatting, conditional formatting, and visualization tools for improved management of your new and existing spreadsheets.
Utilizing the Enterprise Edition of the IBM Information Server suite will enable you to stand up the included Data Governance and Data Quality tools to implement a comprehensive data management solution.
Are you getting the optimal functionality out of your DataStage instances?
Are you thinking of upgrading to 11.7.x? See if the new features for 11.7.1 Fix Pack 4 will improve your DataStage based processing.
We can provide all aspects of support for IBM Information Server DataStage including but not limited to ETL development, code frameworks, migrations, workflows, automation, best practices, installation, configuration, updates, tool administration, system review and solution architecture of new instances.
IBM DataStage Development and Automation
DataStage ETL Development:
We can provide DataStage based ETL code development using the features and best practices of the tool. Our 25 years of experience reaches back into the Server code base as well.
The trick is knowing what stages to use for the 700+ transformations that are available.
Other data sources/targets we typically work with include RDBMS (Oracle, SQL Server, DB2, and Netezza) as well as XML, unstructured data for Excel based content, and flat files. Flat file processing uses csv or custom delimiters. We typically use multiple character delimiters for complex embedded text issues.
Stored procedures, Stored containers, Web Service calls.
Multi-instance jobs to reduce the code base.
We provide an experienced approach to troubleshooting, root cause analysis (“RCA”) and performance tuning of SQL and DataStage code.
For root cause analysis, with the compiled code, the root cause and which stage in a job is causing issues is challenging. Discuss tricks needed to decipher the issue.
We will adapt to your coding standards and SDLC practices. ETL code documentation can be provided per existing standards, deliverables, and methodologies.
Automating DataStage:
Automation of the processing can be created to work seamlessly with your Enterprise Scheduler. We make extensive use of wrapper scripts to extract the "dsjob" command functionality in order to facilitate automated reruns, alternate processing based on warnings, etc.
Sending emails from DataStage depending on the run state of a job within a sequencer.
Use of parameters, parameter sets, project level default parameters for database connectivity criteria, environment separation, DataStage processing and configuration controls, etc.
IBM DataStage Tool Installation and Administration
Tool Installations:
Planning, Solution Architecture, Installation of DataStage tool and other tools in the suite for Windows or Linux/Unix.
Multiple environment setup for one to three tier host machines for various topologies utilizing nodes based on your license agreement.
Set up of the Operations Console to provide real-time monitoring of job runs and compute resources.
Administration:
We are experienced in all aspects of the administration of the DataStage tool including updates, setting up security, projects, users, file management, configuration of the tool, etc.
Backups can be setup and automated to provide disaster recovery as corporate standards dictate.
Monitoring of compute resources and disk space to prevent corruption of the code base and data processing.
Information Governance Catalog (“IGC”)
Describe: We used to IGC to setup a set of business terms that were tied to the database objects and ETL processing for the Data Integration operations.
InfoSphere Metadata Workbench (formerly IMAM)
Tool that stores the metadata associated with the database objects and DataStage code.
Information Analyzer (“IA”)
We perform data profiling of new data sources to determine granularity, cardinality, nullity, and cross table relationships to aid in the creation of data models for new data marts. We also create Data Quality functionality where IA created Data Rules are used within DataStage to provide data quality checks and resolution of data anomalies.
Server Manager
The embedded version control that is provided for DataStage code.
DataStage can be linked into other version control apps like CVS and GIT.
Other tools in the Information Server ("IS") suite
Data Warehousing
We can assist in implementing functionality to automate your data processing using scripting, configuration and notifications for the most popular Enterprise Scheduling tools such as Control-M and Automic (formerly UC4).
We utilize various supporting tools and applications to provide processing using older technologies such as SAS, Perl, Awk, Sed, and other database centric tools.
Database experience includes Oracle, DB2, Netezza, and SQL Server
Finally, we generate the documentation needed to be able to stand up the ETL infrastructure (recover your tools, code and data) utilizing best practices for your database systems and ETL processing.
Streamline your business operations with seamless integration of different systems ranging from COTS products to custom solutions. We provide the architecture, planning and implementation of the applications and configurations needed to meet our customer use cases.
Excel content enchancements - New!
We are expanding our Excel capabilities and will provide more information soon.