Why use the Information Hub?
Integration with virtually any data provider. Built in support for most popular Sql databases, NoSql databases, file types, and third party API's.
You decide how and where to store your data. Whether secured on internal networks or published to the cloud, the integration hub will ensure you keep your data safe.
Over 400 built in functions covering machine learning, financial, statistics and geometry. Custom functions and plugins for more specific needs.
Publish & Share
Easily publish and share your data, charts and dashboards with other users of the platform.
Scale with Ease
Remote agents can be switch on/off on demand and can manage huge data volumes without impacting the performance for other jobs.
Data can be merged, transformed, cleaned, and profiled in many ways. Data can populate a data warehouse, integrate systems, or be published to users.
Features at a glance
- Single central metadata store
- Physical data stored and accessed anywhere
- Easy to scale
- Postgres (including Amazon Aurora)
- Microsoft Sql Server
- IBM DB2
- Azure Storage Tables
- Microsoft Excel
- Delimited Files (such as CSV)
- Json Files
- Xml Files
- REST based API's
- Local File Systems
- Azure Storage
- Bulk Load (for speed)
- Transactional Load (for data integrity)
- Target based change detection
- Source based change detection
- Preserve changes (i.e. type 2 slowly changing)
- Sql like transforms (map, filter, group, join, union)
- Analytical aggregations (such as moving average)
- Join flat tables to structured datasets (such as JSON)
- Series transform to aggregate and even out time series.
- Row generation transform to pivot data.
- Hundreds of built in functions
- Machine Learning - Regression, Sentiment, Recommendation, Clustering, Anomaly detection
- Statistical - Curve fitting, Matrix, Distribution
- Financial - Interest rate, Yield, Discount etc.
- Live data - Weather, Stocks, Currency
- Validate with any built in function
- Create custom/reusable data validations
- Validate via white lists or black lists
- Validate against lookups (i.e. value exists in other table)
- Invalid data can be rejected or stop processing
- Built in profiling functions
- Data type profiling
- Pattern profiling
- Capture profile data with any data processing
- Trigger based on schedule (once off or recurring)
- Trigger based on file event
- Sequence processing based on completion of other jobs
- Custom data views
- Chart data (bar, pie, line, scatter etc.)
- User configurable dashboards which group views and charts into layout
- Publish tables/views/dashboard for private/public groups
- Create REST/JSON Api for external processes
- Strong encryption on passwords and marked sensitive fields.
- Encryption keys decentralized (i.e. cannot be access by Data Experts staff)
- Automatic SSL key generation to encrypt all data in transit
- Local network isolation option which ensures data never leaves local network.
- IP address whitelisting for remote processing agents.
- Completely open source
- Data connectivity plugin (through Microsoft .Net Core)
- Function plugins (through Microsoft .Net Core)