Welcome to CogStack-Nifi’s documentation!

Contents:

• Introduction
  • Development
  • Asking questions
  • Project organisation
  • Documentation and getting started
  • Important news and updates
• NiFi
  • Concepts you should understand in NiFi
  • NiFi directory layout : /nifi
  • Custom Docker image
  • Apache NiFi configuration
  • NIFI security setup
  • Drivers
  • User resources
  • Workflow templates
  • User scripts
  • User schemas
  • Performance settings
  • Accessing NiFi via nifi-api
  • Various data type issues
• Prequisites
  • IMPORTANT NOTE: Do a git-lfs pull so that you have everything downloaded from the repo (including bigger zipped files.).
• Deployment
  • Environment variables
  • Important security detail
  • Services
  • Workflows
  • Troubleshooting
• Available Services
  • Overview
  • Primary services
  • Optional NLP services
  • Security
  • Deployment
  • Data ingestion and storage infrastructure
  • Services & definition description
  • NLP services
  • Jupyter Hub
  • Cleanup
  • Database Stack
  • Samples DB
  • Cogstack-db
  • Apache NiFi
  • Tika Service
  • OCR Service
  • NLP Services
  • ELK stack
  • Jupyter Hub
  • Git-ea
  • NGINX
• Workflows
  • Used services
  • Apache NiFi web user interface
  • Ingesting free-text documents (DB → ES)
  • Adding your own data to the DB
  • Indexing records by Elasticsearch
  • Executing the workflow
  • Ingesting text from PDF documents (DB → ES)
  • Reading records from database
  • Extracting text from PDFs
  • Indexing records by Elasticsearch
  • Annotating free-text documents (DB → ES)
  • Reading records from database
  • Extracting NLP annotations from documents
  • Indexing annotations by Elasticsearch
  • Annotating free-text documents (ES → ES)
  • Reading documents from Elasticsearch
  • Extracting NLP annotations from documents
  • Indexing annotations by Elasticsearch
  • Sending automated emails
  • CogStack Common Schema conversion and ingestion
  • Ingesting raw files from disk with extra optional data
• Security
  • Directory structure
  • IMPORTANT NOTE
  • Generation of self-signed certificates
  • ELK stack
  • JupyterHub
  • Apache NiFi
  • NGINX
• News
  • 13-12-2021 LOG4J Vulnerabity

Indices and tables

• Index

• Module Index

• Search Page