Welcome to CogStack-Nifiβs documentation!ο
Contents:
- CogStack-NiFi
- π° News
- π Prerequisites
- π¦ Deployment
- 𧩠Services
- π Overview
- 𧩠Primary Services
- ποΈ Service Definitions
- π£οΈ NLP/OCR and other services API Endpoints
- 𧬠MedCAT Service
- π οΈ MedCAT Trainer
- π Jupyter Hub
- π§ͺ Samples DB (PostgreSQL)
- π¦ Cogstack databank production DB (Production only: PgSQL, MSSQL)
- π§ Apache NiFi
- π ELK Stack (Elasticsearch / OpenSearch)
- π€ OCR Service
- ποΈ Git-ea
- 𧱠NGINX
- π Troubleshooting
- π Workflows
- Current status (NiFi 2.x)
- Legacy workflow examples (reference)
- Used services
- Apache NiFi web user interface
- Ingesting free-text documents (DB β ES)
- Adding your own data to the DB
- Indexing records by Elasticsearch
- Executing the workflow
- Ingesting text from PDF documents (DB β ES)
- Reading records from database
- Extracting text from PDFs
- Indexing records by Elasticsearch
- Annotating free-text documents (DB β ES)
- Reading records from database
- Extracting NLP annotations from documents
- Indexing annotations by Elasticsearch
- Annotating free-text documents (ES β ES)
- Reading documents from Elasticsearch
- Extracting NLP annotations from documents
- Indexing annotations by Elasticsearch
- Sending automated emails
- CogStack Common Schema conversion and ingestion
- Ingesting raw files from disk with extra optional data
- CogStack Cohort source file creation.
- π§ NiFi
- Concepts you should understand in NiFi
NiFi directory layout : /nifi- Custom Docker image
- Apache NiFi configuration
- Critical
deploy/nifi.envsettings - NIFI security setup
- Drivers
- User resources
- Workflow templates
- User scripts
- User schemas
- Performance settings
- Accessing NiFi via nifi-api
- Various data type issues
- π‘οΈ Security