Supported property types for configuring Datumize Data Collector.

Path

A path represents a reference to a file or directory in the file system. The format depends on the operating system.

Examples

# Directory path for Linux
/opt/datumize/pcap

# Directory path for Windows
c:\Applications\Datumize\Pcap

# File path for Linux
/var/www/html/index.html
BASH

Filename Pattern

These are patterns that get automatically expanded when dealing with file names.

PatternDescription

%{uuid}

Unique identifier as generated by UUID.

%{instance}

Product instance name.

%{year}

Year, hopefully 2020 and beyond.

%{month}

Month of the year in number, from 01 to 12.

%{day}

Day of the month in number, from 01 to 31.
%{hour}Hour of the day, from 00 to 23.

%{minute}

Minute of the hour, from 00 to 59.
%{second}Second of the minute, from 00 to 59.
%{millisecond}Millisecond of the second, from 0 to 999.
%{system-property}

Any property available to the JVM, including system properties and user properties.

For example, %{os.name} will be expanded to the operating system name.

If the JVM has been started with user property -Dmyproperty=foo, then %{myproperty} will be expanded to foo.

Advanced Date Pattern

These are patterns that should be used to compose advanced dates.

PatternDescription

%{uuid}

Unique identifier as generated by UUID.

%{ts}

Timestamp in milliseconds, Unix format (UTC milliseconds since epoch).

%{year}

Year, hopefully 2020 and beyond.

%{month}

Month of the year in number, from 01 to 12.

%{day}

Day of the month in number, from 01 to 31.
%{hour}Hour of the day, from 00 to 23.

%{minute}

Minute of the hour, from 00 to 59.
%{second}Second of the minute, from 00 to 59.
%{millisecond}Millisecond of the second, from 0 to 999.
%{random}

Random long number.

Duration

A duration represents an amount of time, and is expressed in time units as per the following table.

UnitDescriptionExample
msMilliseconds12ms
sSeconds2s
mMinutes0.2m

Unix File Pattern

A Unix-style regular expression used to select files.

ExpressionSelectsExample
*Anything

my_*toto.xls

Selects any file starting with my_ prefix and ending with toto.xls suffix. 

?One (any) character

foo?.csv

Selects files foo1.csv or fooX.csv

stringThat string

*.xml

Selects files with .xml suffix

Capacity

A capacity represents a number of bytes, and is expressed in bytes or multiples (kilo, mega), as per the following table.

UnitDescriptionExample
bBytes1023b
kKilobytes2.1k
mMegabytes0.8m

Classname

A Java class name in fully qualified format, according to Java naming conventions and expected result for Class.getName().

Following class should be named com.datumize.examples.Customer

Examples

package com.datumize.examples;
 
public class Customer
{
  private String id;
  private String name;
   
  public Customer() {}
}
JAVA

Charset

A Charset is related to how a character or string is encoded, and is defined at Java language for every string and byte stream. Some examples:

CharsetDescription
US-ASCIISeven-bit ASCII, a.k.a. ISO646-US, a.k.a. the Basic Latin block of the Unicode character set
ISO-8859-1  ISO Latin Alphabet No. 1, a.k.a. ISO-LATIN-1
UTF-8Default charset. Eight-bit UCS Transformation Format
UTF-16BESixteen-bit UCS Transformation Format, big-endian byte order
UTF-16LESixteen-bit UCS Transformation Format, little-endian byte order
UTF-16Sixteen-bit UCS Transformation Format, byte order identified by an optional byte-order mark

PCAP Network Filter

You can implement network filters using the Berkeley Packet Filter (BPF) syntax. This is the preferred way to filter out network packets that you're not interested in.

Examples:

URL List

A list of URL elements, separated by comma. The URL format actually depends on the expected resource, as illustrated by the examples.

URL ListDescription
myserver:3456,otherserver:3434A list of 2 servers, expressed as simple host:port resource.
http://www.example.com:1080, https://docs.datumize.com/ddc
A list of 2 resources using HTTP(S) protocol.

JSON List

A list of key-value elements, separated by comma, in JSON format.

Examples

{"key1":"value1","key2":"value2"}
{"login":"datumize","password":"datumize123"}
CODE

Parameter List

A list of key-value elements, elements separated by comma, key and value separated by equal, in plain format.

Examples

key1=value1,key2=value2
login=datumize,password=datumize123
CODE

URL

A Uniform Resource Locator, or URL, stands for a string that points to a certain resource, local or remote. It supports multiple protocols.

Examples

https://foo.com/downloads/abc.pdf
file:///var/sftp/downloads/abc.pdf
CODE

IP Filter

An IP filter allows to select peers in an Internet Protocol (IP) communication.

ExpressionSelected IP AddressSelected IP Port
[192.168.1.100/102]:80

192.168.1.100

192.168.1.101

192.168.1.102

80
192.168.1.100/102:80

192.168.1.100

192.168.1.101

192.168.1.102

80
[192.168.1.100]:80192.168.1.10080
192.168.1.100:80192.168.1.10080
192.168.1.100/102

192.168.1.100

192.168.1.101

192.168.1.102

Any

192.168.1.100

192.168.1.100

Any
80Any80

Cron Expression

A cron expression supports a rich grammar to define time events that trigger actions.

This cheatsheet contains the 5 field definitions:

 ┌───────────── minute (0 - 59)
 │ ┌───────────── hour (0 - 23)
 │ │ ┌───────────── day of the month (1 - 31)
 │ │ │ ┌───────────── month (1 - 12)
 │ │ │ │ ┌───────────── day of the week (0 - 6) 
 │ │ │ │ │              (Sunday to Saturday)
 │ │ │ │ │
 │ │ │ │ │
 * * * * * 

Script Language

A script in one of the scripting languages supported by DDC Extensibility (SDK).