FAQ

Frequently Asked Questions

Get all your SCIKIQ related questions answered on our FAQ page. Discover everything from product features to Platform capabilities and more

SCIKIQ is a data fabric platform that provides a comprehensive solution for enterprise data management. It includes features for data integration, data governance, and data curation, as well as a built-in visualizer for creating reports and dashboards.

SCIKIQ is the ultimate solution for your enterprise data management needs. With its all-in-one data platform, SCIKIQ streamlines data management, seamlessly integrates with your existing infrastructure, and eliminates the need for multiple vendors and point solutions. The innovative, automation and AI driven platform is designed to be user-friendly and cost-effective, making it accessible to all business users without the need for coding or extensive technical skills. SCIKIQ simplifies change management and eliminates lock-in periods, giving you the freedom to manage your data on your own terms. Whether you need to integrate, govern, or curate your data, SCIKIQ has you covered.

SCIKIQ is a unique data fabric management platform that offers a comprehensive solution for data integration, governance, and curation. Unlike other data integration tools on the market, SCIKIQ provides an all-in-one platform that consolidates multiple vendors and point solutions into a single solution. This not only simplifies the data management process, but also helps organizations save costs and time.

One of the key differentiators of SCIKIQ is its automation capabilities. The platform utilizes AI-driven features to automate data discovery, integration, and curation tasks. This means that organizations no longer have to rely on manual processes, which can be time-consuming and error-prone. Instead, SCIKIQ's automation capabilities enable organizations to quickly and easily discover, integrate, and curate data, thus providing them with the ability to make data-driven decisions more efficiently. Additionally, SCIKIQ’s automation provides a level of scalability, intelligence and significantly reduces the time-to-value of data.

SCIKIQ can be used in a variety of industries, including finance, healthcare, retail, and more. Its flexibility and scalability make it suitable for organizations of all sizes, across different domains.
SCIKIQ provides a comprehensive solution for integrating data from different sources and aligning different application systems. This helps to break down data silos and improve data sharing across teams. Additionally, the platform includes data governance and curation tools that enable organizations to identify and address data quality issues.
Some of the key benefits of using SCIKIQ include a user-friendly and intuitive platform designed for business users, cost-effectiveness, automation, scalability, low support requirements, and a hybrid/multi-cloud platform.
SCIKIQ provides organizations with the tools they need to make data-driven decisions and drive business growth. The platform includes features for data integration, governance, and curation, as well as a built-in visualizer for creating reports and dashboards.
SCIKIQ is designed to be flexible and scalable, making it suitable for organizations of all sizes. Whether you're a small business or a large enterprise, SCIKIQ can provide the data management tools you need to make better decisions and drive business growth.
SCIKIQ is designed to be user-friendly and intuitive, requiring minimal skill sets. The platform includes a drag-and-drop visual interface that makes it easy to build and deploy data integration and transformation pipelines, as well as automate data governance and cur
SCIKIQ supports a wide range of data sources including structured and unstructured data from databases, data warehousing products, file systems, application stores such as SAP and Salesforce, and Hadoop ecosystem. It also supports real-time sources like Kafka Confluent and log-based CDC using Debezium. Additionally, SCIKIQ offers process migration capabilities which allows users to capture data using standard process migration recipes.
Yes, SCIKIQ is designed to handle high volume data processing, even millions of records at the same time. It offers a cost-effective method for processing data on cloud or on-premise with maximum data privacy and security.
Yes, SCIKIQ offers two scheduling tools - SCIKIQ Orchestrator and SCIKIQ Schedules. The Orchestrator helps you schedule tasks, jobs, and emails without any hassle. The Schedules tool keeps a track of all scheduled jobs and emails.
SCIKIQ Connect, the data integration tool within the SCIKIQ platform, can handle data integration from multiple sources including databases, data warehousing products, application stores, file systems, and real-time sources. It also has pre-configured integration options for popular data sources such as SAP and Salesforce.
Yes, SCIKIQ Connect has the capability to handle complex integration scenarios with multiple use cases. It also offers advanced, bi-directional integrations and can deal with different data formats and varying quality and volume of data.
With SCIKIQ Connect, data integrations can be set up in minutes, saving critical time for the business users. The platform also has a simple, drag-and-drop visual interface for building and deploying data integration and transformation pipelines without the need for coding.
Yes, SCIKIQ Connect is a modern solution for multi-cloud and multi-vendor data integration. It allows organizations to correlate data from different sources and align different application systems to improve cross-team data sharing.
Yes, SCIKIQ Connect supports real-time data integration and allows for moving data faster for real-time analytics and data availability for the business users. It also has built-in support for real-time data sources such as Kafka Confluent and Log based CDC using Debezium.
A: SCIKIQ Control is a best-in-class data governance tool that helps organizations ensure compliance and risk management while streamlining their data management processes. With features like automated data discovery, metadata extraction, and data quality management, SCIKIQ Control helps organizations maintain control over their data while meeting regulatory requirements.
Yes, SCIKIQ Control can discover data across a variety of sources and platforms, including databases, file systems, and application stores. It also has built-in support for extracting metadata from existing data, making it easy to identify and understand the relationships between different data sources.
SCIKIQ Control uses Neo4J to capture data lineage at every stage of the data journey and provides a complete 360-degree view of the system. This helps organizations understand where each resource is being used and identify duplicity, encouraging re-use of existing modules.
Yes, SCIKIQ Control includes a Data Quality Management feature that allows organizations to define and enforce data quality rules, detect personally identifiable information (PII), and detect and correct data errors. This helps organizations ensure that their data is accurate, reliable, and fit for purpose.
SCIKIQ Control includes a metadata management feature that enables organizations to establish policies and processes for integrating, sharing, and protecting information in the form of assets, glossaries, business data, and entities. It also provides a data cataloging feature that makes it easy to understand the relationships between different data sources and identify their attributes, keys, and relationships.
Data curation in SCIKIQ is an important aspect of the data management process that allows organizations to bridge the gap between different stakeholders, departments, data owners and developers. SCIKIQ Curate provides a broad framework of data curation tools like the Data Prep Studio, Logical and Business Data Modeling, Orchestrator & Schedules that allow users to perform various data transformation functions, join multiple tables from various sources, and create a data model that can be easily understood and used to drive business growth.
SCIKIQ Curate’s Logical Data Modelling works as a blueprint and describes data elements in detail & is used to develop visual understandings of data entities, attributes, keys, and relationships. Business Data Modelling, on the other hand, helps in understanding the relationships between various bits of data and refer to the data models already created via Data Prep Studio and Logical Data Modelling. In addition to viewing the data models, the user can edit, schedule and define business & technical metadata.
Yes, SCIKIQ Curate is designed to handle high volumes of data i.e. even millions of records at the same time, at a cost-effective method on cloud. The platform also uses AI/ML intelligence to complete data curation in real-time, thus making it more efficient and faster to access.
SCIKIQ Curate provides two data curation tools for scheduling – SCIKIQ Orchestrator and SCIKIQ Schedules. SCIKIQ Orchestrator helps in scheduling various tasks, jobs & emails without any hassles, while SCIKIQ Schedules lists down all the scheduled jobs & emails and keeps a track of the same. This helps in automating tasks, eliminating the need for manual kick-offs and reducing delays.
SCIKIQ Curate provides various features to ensure data quality, such as Data Quality Management - Rules and Dashboards, Advanced Power BI/Tableau Metadata Engine with Report Classifier and Document Scribe. Data Quality ensures better decisions by understanding Distribution, Freshness, Volume and Schema Change through Data Observatory. Data Profiling tool helps in editing, applying filters, detecting PII, defining data quality rules, predictive decision making, proactive crisis management, and organized sorting.
Data integration refers to the process of combining data from multiple sources into a single, unified view, while data engineering refers to the process of designing, building, and maintaining the infrastructure and systems that support the collection, storage, and analysis of that data. With SCIKIQ, data integration and data engineering are integrated into one platform, making it easy to handle all data management tasks in one place.
SCIKIQ's automated data discovery process uses advanced algorithms and AI-driven features to scan and identify relevant data sources across an organization. This process not only saves time and effort, but also ensures that all relevant data is captured and integrated, leading to more accurate and actionable insights.
No, SCIKIQ's automated data discovery process is fully automated and requires minimal manual input. Once the process is set up, it can run on its own, allowing users to focus on other important tasks.

Yes, SCIKIQ's automated data discovery process is designed to handle both structured and unstructured data sources, including databases, application stores, file systems, and more. It can also integrate data from various sources and platforms, making it a versatile solution for organizations of all types and sizes.

Create a meta tag, title for FAQ Page on SCIKIQ website 

Meta tag: "Frequently Asked Questions about SCIKIQ - Data Fabric Management Platform" Title: "SCIKIQ FAQ - Your Go-To Resource for Data Fabric Management Solutions"

Yes, Parent company of SCIKIQ, Data and analytics services gets a Mention in The Augmented Business Intelligence Platforms Landscape, Q1 2023 along with 34 global vendors as a general Purpose platform that can be used to build any domain application. SCIKIQ Gets this mention along with AWS, Tibco, DOMO, Microsoft, Salesforce and Google Cloud to name a few

The client is not required to purchase any additional software for the third-party dependent components as the community editions have been selected to reduce the overall solution cost.

SCIKIQ includes a default 1 TB HP Microfocus Vertica Analytic Cluster, which is suitable for medium-sized organizations and offers 10X compression. This eliminates the need for the client to purchase a separate MPP solution. 

  • Data warehousing Products
  • Python for overall SCIKIQ Platform
  • Elastic (ELK) Stack for log and APM management – Free Community Edition
  • Rabbit MQ for message queuing – Free Community Edition
  • Elastic Search as a metadata search engine -– Free Community Edition
  • Neo4j for relationship storage – Free Community Edition
  • Python for machine learning
  • Vertica (1 TB default with SCIKIQ, 10X compression for medium organizations)
  • Client's own MPP for data lake and analytics cluster
  • Confluent Kafka for real-time data ingestion – Free Community Edition
  • Debezium for log-based Change Data Capture (CDC) – Free Community Edition
  • Plotly/D3.js - Free Open-Source edition for Charts
  • GoJS - Paid Library for lineage, included in SCIKIQ licensing cost.
  • Django - Application Server
  • Infra - Any Cloud/On Premise Infra
  • SCIKIQ is designed with security as a top priority. Unlike a SaaS platform, SCIKIQ operates within the client organization's trust network, ensuring that client data never leaves their premises. To ensure the highest level of security, SCIKIQ is set up as a Virtual Private Cloud (VPC) with a separate subnet, and sub-net to sub-net VPC pairing is performed between the client's existing infrastructure and the new SCIKIQ deployment.

    SCIKIQ implements industry-standard security protocols, such as encryption for all data transfers, access controls, and authentication mechanisms to ensure the protection of sensitive data. Regular security audits and threat assessments are conducted to identify and mitigate potential risks. Additionally, SCIKIQ follows strict data privacy regulations, such as GDPR, to ensure the protection of personal data.

    For added security, SCIKIQ also provides options for customers to host their data on-premises or in a private cloud. With SCIKIQ, clients can feel confident that their data is secure and always protected.

    SCIKIQ's roadmap for its excellence in managing unstructured data lineage, specifically in the IoT space, includes the following steps:

    Continuous Development: SCIKIQ is committed to continuously updating and improving its platform to stay ahead of the curve in managing unstructured data lineage. This includes staying up-to-date with the latest advancements in IoT technology.

    Expansion of Partner Ecosystem: SCIKIQ plans to expand its partner ecosystem to include companies specializing in IoT solutions, allowing it to provide integrated solutions to customers and a more comprehensive approach to managing unstructured data lineage in IoT environments.

    Investment in Research and Development: SCIKIQ is dedicated to investing in R&D to create innovative solutions for managing unstructured data lineage in IoT environments, providing customers with the latest advancements in the field.

    As part of SCIKIQ's roadmap, the platform will include the following capabilities to achieve excellence in managing unstructured data lineage in IoT environments:

    Data Integration: Using the built-in Connect library, SCIKIQ can integrate data sets and streams with support for generic protocols such as HTTP, Kafka, MQTT, Files, or specific adapters for open data sources. The adapters can be easily configured from the user interface.

    Pre-processing: SCIKIQ allows for the addition of pre-processing rules, such as the transformation of measurement units, to harmonize data before ingestion.

    Analysis: SCIKIQ's real-time algorithm toolbox allows for the harmonization and analysis of data, including simple filters and pre-trained neural networks.

    Exploitation: SCIKIQ allows for the exploitation of analyzed data by triggering notifications, configuring real-time dashboards, or sending data to third-party systems such as databases, external services, or IoT actuators.