ETL Software

Modern businesses and the technologies that are empowering them to succeed run on real-time data - and lots of it - from multiple sources and in many formats.

Our ETL software gives you a complete Data Science toolkit that enables ingest, interpret, analyse and distribute data to connected systems and solutions effortlessly and, critically, in the moment. Effective as both sophisticated middleware, or as a complete platform for building AI applications; Rayven is an easy way for you to do (A LOT) more with your data.

API (Application Programming Interface) enables you to retrieve data from an API endpoint via an HTTP GET request. Find out more.
SQL (Structured Query Language) uses a connection string to communicate with an SQL server. It can be used to run SQL queries within the Raven workflow and will output the results in the payload for each applicable device. Find out more.
MQTT (Message Queuing Telemetry Transport) is a lightweight communication protocol ideal for embedded devices with limited connectivity. It is the preferred communication mechanism between your devices and the Rayven platform. Find out more.
Modbus connects industrial electronic devices using either character serial communication lines, Ethernet, or the IP suite as a transport layer. Modbus supports communication between multiple devices connected to the same cable or network and is often used to connect RTUs and SCADA systems. Find out more.
AMQP (Advanced Message Queuing Protocol) is an open standard application layer protocol for message-oriented middleware and directly integrates with the platform. Find out more.
SNMP (Simple Network Management Protocol) provides a common language for network devices to relay management information within single and multi-vendor environments in a local area network (LAN) or wide area network (WAN). The SNMP node can receive data from devices that use the SNMP application-layer protocol. Find out more.
UDP + Raw UDP (User Datagram Protocol) enables you to receive and utilise data from devices and systems as a comma-delimited string. Find out more.

FTP (File Transfer Protocol) enables simple, rapid transmission of a file across a network supporting TCP/IP. Generally, this network will be the Internet or a local network. It extracts files from an FTP folder and parses them as JSON payloads for onward processing. Find out more.
AWS S3 periodically polls data from an AWS S3 bucket, outputting payloads at the interval configured. It will pull data stored in your AWS S3 bucket onto the Rayven platform. Find out more.
HTTP (Hypertext Transfer Protocol) is a common application protocol used in distributed, collaborative, and hypermedia information systems. The HTTP node enables users to send data to the workflow via POST and GET methods. Find out more.
OPC (Open Platform Communications) is a cross-platform, open-source, IEC62541 standard for data exchange. It replaces OPC Data Access (OPC DA), which only communicates real-time data (not historical data, alarms, or events). The Rayven OPC node uses the OPC UA protocol to request data from remote PLCs via an OPC UA server. It does this over an IP connection. Find out more.
LoRa is LoRaWAN is a media access control (MAC) protocol for wide area networks. It enables low-powered devices to communicate with Internet-connected applications over long-range wireless connections. LoRaWAN can be mapped to the second and third layers of the OSI model. It is implemented on top of LoRa or FSK modulation in industrial, scientific and medical (ISM) radio bands. Find out more.
CSV. Rayven features easy csv file ingestion, so that you can integrate historical data from any source for use within your solutions and convert csv to JSON (or anything else). Use it to give further context to real-time data analysis, give historical background, or to train machine learning algorithms. Find out more.

Our platform's dynamic integration nodes allow for third-party integrations through configuration, eliminating the need for coding. This enables Rayven to connect with a wide array of devices, cloud services + databases using our Workflow Builder's Function Node (ready-to-go formulas here), including:

Gateways		Gateways	Other
Acoem	Fusion HVAC	Cisco Merkai	Beckhoff PLCs
Adroit	Libellium Sensors	Sierra Wireless	Bosch Rexroth
Browan	QuantAQ	Teltonika	Loadrite
Davis	Schneider	Robustel	Robustel
Digicore	Sentek	RAD	Omron
Directed Telematics	Sound Science	Browan	Open Weather
Ellenex	Ventia	Billion	Rockwell FactoryTalk SCADA
Endress+Hauser	Wattwatchers	Phoenix Connect	SAP

For more complex, legacy, or unique system integrations, we can deploy customised scripts.

Custom scripts are used to establish connections with systems that lack API or standard connectivity options. This capability allows you to integrate and automate data flows from a wide range of sources, ensuring that even legacy or proprietary systems can be a part of modern applications.

By writing custom scripts, we enable you to extract, process, and send (ETL) data to and from these systems; enhancing the interoperability and flexibility of your applications. This bidirectional also opens up the potential for leveraging Machine Learning, custom workflows, automations + Generative AI to improve operations across your full technology stack.

2: Secure, infinitely-scalable data storage

Rayven doesn't just give your raw, unstructured data context, it also secures it for you in our a protected Cassandra database.

Our approach not only means that you don't need to worry about data storage and security (explore our full Enterprise Security features here), but it also ensure data availability at any given moment for anything - both within and outside the platform - delivering you a real-time single source of truth to do whatever you want with.

Case Node: This node likely allows for conditional branching in the data flow, similar to a switch-case statement in programming. Depending on the data's attributes or values, it can route the data through different paths for distinct processing.
Combine Node: It merges data from multiple sources or streams, facilitating operations that require a unified view of data from diverse inputs, enhancing the platform's capability to handle complex data integration scenarios.
Extract Device IDs Node: This specialised node is tailored for scenarios where identifying and extracting device identifiers from the data stream is crucial, commonly used in IoT apps or when device-specific analytics are required.
Field Split Node: This node splits data fields based on specified criteria, such as delimiters, facilitating the extraction and individual processing of nested data elements within a larger dataset.
Filter Node: It enables data to be filtered based on defined criteria, ensuring that only relevant data points are passed down the workflow for further processing, enhancing efficiency and focus in data analysis.
Queue Node: This node manages data flow by queuing messages or data points, ensuring orderly processing and handling backpressure effectively, which is essential in maintaining performance in real-time systems.
Rule Builder Node: Allows users to define complex business logic and rules that can be applied to the data stream, providing a flexible way to implement custom data processing and decision-making logic without deep programming.

Aggregation Node: This node supports aggregating data over specified periods or conditions, enabling summarisation, trend analysis, and statistical computations, crucial for insights and decision-making.
Formula Node: Offers the ability to apply mathematical or logical formulas to data points, transforming data based on custom expressions, which is essential for calculated fields and derived metrics.
JavaScript Node: This powerful node allows for the execution of custom JavaScript code, providing limitless possibilities for data transformation, custom logic implementation, and integration with other systems or APIs.
Multifunctional Node: A versatile node that supports multiple functions or custom logic in a single node, allowing for complex data transformations and processes to be encapsulated neatly, enhancing workflow efficiency and readability.

Email: Email can be used for alerts, reports, and sharing data files (attachments) from Rayven to users or systems that accept email inputs.
SMS: Short Message Service (SMS) allows sending text messages to mobile devices. This method is used for immediate alerts, notifications, or sending concise data points from Rayven to users in scenarios where internet access might be limited or immediate attention is required.
API: Application Programming Interface (API) enables direct, programmatic interaction between Rayven and other software systems. APIs are used to send data securely and efficiently, triggering actions in other systems.
FTTPS: File Transfer Protocol Secure (FTPS) is used for secure file transfer from Rayven to other systems, suitable for bulk data transfers that require encryption.
HTTP: Hypertext Transfer Protocol (HTTP) can be used for sending data from Rayven to web servers or other platforms via API calls or webhooks, facilitating integration with web-based services, applications, and cloud-based systems.
Modbus: Modbus can be used to send data from Rayven to PLCs (Programmable Logic Controllers) or other industrial devices, enabling integration with industrial control systems and equipment for monitoring and control purposes.
MQTT: Message Queuing Telemetry Transport (MQTT) MQTT is highly-suitable for use in IoT applications, allowing Rayven to efficiently send data to and from devices or other systems in a publish/subscribe model, ideal for real-time data communication in constrained environments.