V4 Design: dbdInterfaces
EPICS: dbdInterfaces - IOC Database Description
September 9 2005
Overview
This document describes definitions for code that accessses IOC records, i.e. the records created from Database Definitions. The definitions are intended for code that:
- includes header files generated from dbd definitions. Header files are generated from the following dbd definitions:
- record - Should only be included by record support.
- struct - Included by code that understands the struct.
- menu - Included by code that understands the menu.
- does not include the header files.
Syntax
The syntax is defined so that it is easy to provide C++ and Java definitions.
NOTE: Most of the code fragments use Java syntax.
Primitive Types
- boolean - a value that takes the values true or false
- octet - an 8 bit byte
- int16 - a 16 bits signed integer
- int32 - a 32 bit signed integer
- int64 - a 64 bit signed integer
- float32 - a 32 bit IEEE float
- float64 - a 64 bit IEEE float
In Java these types become:
- boolean => boolean
- octet => byte BUT no arithmetic is implied
- int16 => short
- int32 => int
- int64 => long
- float32 => float
- float64 => double
In C++ these types become:
- boolean => bool
- octet => char BUT no arithmetic is implied
- int16 => int16_t
- int32 => int32_t
- int64 => int64_t
- float32 => float
- float64 => double
NOTE:
- The C++ integer types require C99 stdint.h
- Should exceptions be defined?
enum, struct, interface, class, string, array
In adition to the primitive types the syntax uses the terms enum, struct, interface, and array.
enum
An example of an enum is:
enum LinkDir { LinkDirNone, LinkDirProcess, LinkDirIn, LinkDirOut, LinkDirInOut }
The C++ definition is identical. In Java 5 the definition would be:
public enum LinkDir { LinkDirNone, LinkDirProcess, LinkDirIn, LinkDirOut, LinkDirInOut };
struct
An example of a struct definition is:
struct DisplayLimitData { float64 low; float64 high; }
In C++ this would be:
class DisplayLimitData { public: double low; double high; };
In Java this would be:
class DisplayLimitData { public double low; public double high; }
interface
An example of an interface definition is:
interface DbfBoolean extends Dbf { boolean get(); void put(boolean val); }
In C++ would be:
class DbfBoolean : public Dbf { public: virtual bool get() = 0; virtual void put(boolean val) = 0; };
In Java would be:
interface DbfBoolean extends Dbf { boolean get(); void put(boolean val) }
class
For now only static class definitions are required. An example of a static class definition is:
static class RegisterSupport { link(SupportFactory support, string name); ... }
In C++ would be:
class RegisterSupport { public: static link(SupportFactory &support, int nameLength, char name[]); ... };
On Java would be:
public final class RegisterSupport { public static final link(SupportFactory support, string name); ... }
string
For C++ a string will be a char * array containing UTF-8 compatible characters not necessarily terminated with a null character. Wherever a string argument appears, the C++ definition will have len and char * arguments.
For Java string will just be a String. It is assumed that Java Strings will be converted to/from UTF-8 byte streams when the data is transfered to/from the network.
An example of a definition that includes a string argument is
void get(string name);
In C++ this will become
void get(int lenName, char *name);
In Java this will become
void get(String name);
array
An example of a definition that includes an array is:
void get(float64[] data);
In C++ ,this would become:
void get(int lenData, doible data[]);
In Java this would be:
void get(doible[] data);
C++ support for strings and arrays
Note that the support described here is not needed for Java since Java already provides facilities
string support
The following interfaces are for allocating tempory storage for strings:
class NonmutableString { public: void destroy(); // Call this when done with string int32 getLength(); char data[]; } class NonmutableStringFactory { public: static NonmutableString *create(int32 len,char data[]); }
class MutableString : public NonmutableString { public: int32 getCapacity(); void setLength(int32 len); } class MutableStringFactory { static MutableString *create(int32 int32 capacity); }
These will use free lists to manage the storage for the octet arrays.
array support
// ArrayCopy only works on primitive types class ArrayCopy { public: void copy(DbfArray from,DbfArray to); }
This only supports primitive types, i.e. DbfBoolean,...,DbfFloat64.
Arithmetic Type Conversions
class DbfConvertScalar { public: static int16 get(Dbf from); static int32 get(Dbf from); static int64 get(Dbf from); static float32 get(Dbf from); static float64 get(Dbf from); static get(Dbf from, int32 lenValue,const *char value); static get(DbfBoolean from, int32 lenValue,const *char value); static put(Dbf to, int16 value); static put(Dbf to, int32 value); static put(Dbf to, int64 value); static put(Dbf to, float32 value); static put(Dbf to, float64 value); static put(Dbf to,int32 lenValue,const *char value); static put(DbfBoolean to, int32 lenValue,const *char value);
static get(DbfArray from, int16 value[]); static get(DbfArray from, int32 value[]); static get(DbfArray from, int64 value[]); static get(DbfArray from, float32 value[]); static get(DbfArray from, float64 value[]); static put(DbfArray to, int16 value[]); static put(DbfArray to, int32 value[]); static put(DbfArray to, int64 value[]); static put(DbfArray to, float32 value[]); static put(DbfArray to, float64 value[]); }
NOTES:
- For Dbf to and from must be one of DbfInt16, ..., DbfFloat64
- The get to a string uses printf semantics
- The put from a string value just uses scanf semantics.
- The DbfBoolean method supports all the choices specified in the DBD Record Instance Specification
- For DbfArray tt>to and from must be an array of one of DbfInt16, ..., DbfFloat64
DbfTypes
The following naming conventions are used:
- Dbf
- any class starting with Dbf describes a field in a generated header file. For example DbfArray describes a field generated from field(name,array(float64[]).
- Dbd
- A class name starting with Dbd describes something related to dbd definitions. For example DbdMenu describes a dbd menu definition.
All Dbf and Dbd definitions are interfaces. Thus all access to data is via interfaces. The IOC database implements the interfaces, with help from record, link, and device support. After initialization data can only be accessed via the interfaces. This allows the database to handle actions like posting database monitors without any help from record, link, or device support.
DbfTypes.h
The following enum definitions describe each field in the header files generated from DBD struct and record definitions.
enum BasicType { basicTypeBoolean, // DbfBoolean basicTypeOctet, // DbfOctet basicTypeInt16, // DbfInt16 basicTypeInt32, // DbfInt32 basicTypeInt64, // DbfInt64 basicTypeFloat32, // DbfFloat32 basicTypeFloat64, // DbfFloat64 basicTypeString, // DbfString basicTypeArray, // DbfArray basicTypeStruct, // DbfStruct }
enum DbfType { dbfTypeBasic, // DbfBoolean,...,DbfStruct dbfTypeMenu, // DbfMenu dbfTypeEnum, // DbfEnum dbfTypeLink, // DbfLink dbfTypeDevice, // DbfDevice dbfTypeMDArray, // DbfMDArray dbfTypeTimeStamp // DbfTimeStamp }
Discussion of DbfTypes
The following shows the code generated from DBD files:
structure definitions
Two class implementations are generated from struct(name) definitions.
- A class named name
- A class named nameSupport
The class name extends:
interface Struct { Dbf getField(int16 index); }
If a structure is defined as:
struct(DisplayLimit) { field(low,double) field(high,double) }
A generated file DisplayLimit.java contains:
puiblic class DisplayLimit implements Struct{ public DbfFloat64 low; public DbfFloat64 high; public static final int16 lowIndex = 1; public static final int16 highIndex = 2; public static final int16 lastIndex = indexHigh; Dbf getField(short index) { switch(index) { case lowIndex: return(low); case highIndex: return(high); default: throw java.lang.IllegalStateException; } return null; } }
A generated file DisplayLimitSupport.java contains:
For struct(displayLimit) the following code is generated for Java
public class DisplayLimitData { public double low; public double high; } public final class DisplayLimitSupport implements StructFactory{ public Struct create() { return new DisplayLimit; } public static final void get(DbfStruct from,DisplayLimitData data) { DbfFloat64 dbf = from.getInterface(1); data.low = dbf.get(); DbfFloat64 dbf = from.getInterface(2); data.high = dbf.get(); } public static final void put(DbfStruct to, DisplayLimitData data) { DbfFloat64 dbf = to.getInterface(1); dbf.put(data.low); DbfFloat64 dbf = to.getInterface(2); dbf.put(data.high); } }
public final class DisplayLimitSupportRegister { static public createAndRegister() { DisplayLimitSupport support = new DisplayLimitSupport; RegisterSupport.structure(support,"DisplayLimit"); } }
NOTE The V4 replacement for registerRecordDeviceDriver must call DisplayLimitSupportRegister.createAndRegister.
Similar files are generated for C++.
For C++ similar code is generated.
record definitions
If a record is defined as:
record(Example) extends IocRecord { ... field(fboolean,boolean) field(octet,octet) field(fint,int16) ... field(ffloat,float64) field(string,string) field(array,array(double[]) field(mdarray,array(double[,]) field(menu,menu(name)) field(fenum,enum) field(link,link(in)) field(device,link(in,analogIO)) field(displayLimit,struct(DisplayLimit)) }
The generated Java file is
public class ExampleRecord implements Struct { public DbfBoolean fboolean; public DbfOctet ctet; public DbfInt16 fint; ... public DbfFloat64 ffloat; public DbfString string; public DbfArray array; public DbfMDArray mdarray; public DbfMenu menu; public DbfEnum fenum; public DbfLink link; public DbfDevice device; public DbfStruct displayLimit; public static final int16 fbooleanIndex = 1; ... public static final int16 lastIndex = displayLimitIndex; Dbf getField(short index) { switch(index) { case fbooleanIndex : return(fboolean); ... case displayLimitIndex: return(displayLimit); default: throw java.lang.IllegalStateException; } } }
public final class ExampleRecordFactory implements StructFactory{ public static final Struct create() { return new ExampleRecord; } }
public final class ExampleRecordFactoryRegister { static public createAndRegister() { ExampleRecordFactory factory = new ExampleRecordFactory; RegisterSupport.record(factory,"ExampleRecord"); } }
NOTE The V4 replacement for registerRecordDeviceDriver must call ExampleRecordFactoryRegister.createAndRegister
Similar code is generated for C++.
Database Fields
Each database field is accessed via an interface which all extend the following interface:
interface Dbf{ boolean isPrimitive(); // BasicTypeBoolean,...,BasicTypeFloat64 boolean isBasic(); BasicType getBasicType(); RecordInstance getRecord(); int16 getIndex(); }
The interfaces are designed as follows:
- DbAccess provides storage for fields and never exposes the address of any field.
- DbAccess posts monitors when a field is modified.
The fact the each field is an object means that additional storage is required. DbAccess will probably have something like the following:
class Field { RecordInstance instance; short index; }; ... class IntField extends Field { int data; } ...
This each field has the overhead of
- instance - a reference to RecordInstance
- index - a 16 bit integer
- vtbl - a reference to the object implementation
An additional pointer field will be needed for things like monitors. This field can start out null and only allocate additional storage as needed.
Primitive Types
DbfOctet, ..., DbfFloat64 are all interfaces with methods get and put.
interface DbfBoolean extends Dbf { boolean get(); void put(boolean val); } interface DbfOctet extends Dbf { octet get(); void put(octet val); } interface DbfInt16 extends Dbf { int16 get(); void put(int16 val); } interface DbfInt32 extends Dbf { int32 get(); void put(int32 val); } interface DbfInt64 extends Dbf { int64 get(); void put(int64 val); } interface DbfFloat32 extends Dbf { float32 get(); void put(float32 val); } interface DbfFloat64 extends Dbf { float64 get(); void put(float64 val); }
Record support code can access such fields via the generated header
file. Some examples are:
ExampleRecord record; short myint; ... precord.ffloat.put(10.0); ... myint = precord.fint.get();
Code that does not include the generated header file can access these fields via the introspecion interfaces described later in this document. For example code that expects a float64 field can access it via
DbAddr dbdAddr = LocateInstance.getPV("recordname.value"); if(dbdAddr==null) // do something Dbf dbf = dbdAddr.getField(); if(!dbf.isPrimitive() || (dbf.getBasicType() != basicTypeFloat64) ) // do something DbfFloat64 dbfdouble = (DbfFloat64)dbf; dbfdouble.put(10.0);
String fields
The interface for a string field is:
interface DbfString extends Dbf { int32 getLength(); void get(string value); void setPutSize(int32 size); void put(string value); }
The following code prints a string.
ExampleRecord record; String string; record.fstring.get(string); printf("%s\n",string);
Code that does not include the header file can use the introspection methods to locate the DbfString that provides access to the field.
Structure Fields
interface DbfStruct extends Dbf { int16 getNfields(); Dbf getInterface(int16 index); DbdField getDescription(int16 index); }
The following traverses the fields of a DbfStruct
DbfStruct dbfStruct; for(i=0; i < dbfStruct.getNfields(); i++) { DbdField dbdField = dbfStruct.getDescription(i); String name; dbdField.getName(name); printf("field %s\n",name); }
Structure fields can only be accessed via introspection.
However, for each structure, code is generated that does the introspection.
For example DisplayLimitData can be obtained via the statements:
ExampleRecord record; DisplayLimitData limits; ... DisplayLimitSupport.get(record.displayLimit,limits); printf("low %f high %f\n",limits.low,limits.high);
Array Fields
interface DbfArray extends Dbf { DbfType getType(); int32 getNelements(); void setNelements(int32 len); }
interface DbfOctetArray extends DbfArray { int32 get(int32 offset, int32 len, octet[] pto); int32 put(int32 offset, int32 len, octet[] pfrom); }
interface DbfBooleanArray extends DbfArray { int32 get(int32 offset, int32 len, boolean[] pto); int32 put(int32 offset, int32 len, boolean[] pfrom); }
interface DbfInt16Array extends DbfArray { int32 get(int32 offset, int32 len, int16[] pto); int32 put(int32 offset, int32 len, int16[] pfrom); }
interface DbfInt32Array extends DbfArray { int32 get(int32 offset, int32 len, int32[] pto); int32 put(int32 offset, int32 len, int32[] pfrom); }
interface DbfInt64Array extends DbfArray { int32 get(int32 offset, int32 len, int64[] pto); int32 put(int32 offset, int32 len, int64[] pfrom); }
interface DbfFloat32Array extends DbfArray { int32 get(int32 offset, int32 len, float32[] pto); int32 put(int32 offset, int32 len, float32[] pfrom); }
interface DbfFloat64Array extends DbfArray { int32 get(int32 offset, int32 len, float64[] pto); int32 put(int32 offset, int32 len, float64[] pfrom); }
interface DbfStringArray extends DbfArray { DbfString getInterface(int32 index); }
interface DbfArrayArray extends DbfArray { DbfArray getInterface(int32 index); }
interface DbfStructArray extends DbfArray { DbfStruct getInterface(int32 index); }
The following puts data into a float64 field.
ExampleRecord record; double[] data; int nelements; // this is number of elements DbfFloat64Array array = precord->array; ... array.put(0,nelements,data);
NOTES:
- It must be possible for support to provide an implementation of get and put. It must be possible to do this in segments. For example
- A circular buffer requires two segments
- If the memory is in hardware, the support can read/write the data in segments. Transient recorders are an example.
- If support implements get and put then DbAccess does NOT manage storage but just calls support to get/put data.
DbfMDArray
NOT YET DEFINED
DbfMenu
DbfMenu is described as:
interface DbfMenu extends Dbf { int16 getIndex(); void putIndex(int16 val); DbdMenu getDbdMenu(); }
DbfMenu allows the menu index to be set and retrieved and also provides access to the DbdMenu.
A DbfMenu field can be accessed via the generated header file or via the introspection methods.
DbfEnum
DbfEnum is described as:
interface DbfEnum extends Dbf { int16 getIndex(); void putIndex(int16 val); DbfStringArray getChoiceArray(); }
DbfEnum allows the enum index to be set and retrieved
and also provides access to the The DbfArray field that contains the choices.
DbfLink and DbfDevice
DbfLink is described as
enum LinkDir { LinkDirNone, LinkDirProcess, LinkDirIn, LinkDirOut, LinkDirInOut } interface DbfLink extends Dbf { LinkDir getDir(); DbdLink getDbdLink(); LinkSupport getSupport(); } interface DbfDevice extends Dbf { LinkDir getDir(); DbdDevice getDbdDevice(); Support support; // Support is base class for device support }
See below for the description of support, which included record, link, and device support.
DbfTimeStamp
struct TimeStamp { int64 secondsSinceEpoch; int32 nanoSeconds; }
interface DbfTimeStamp extends Dbf { void get(TimeStamp timeStamp); void put(TimeStamp timeStamp); }
DbdStatements
These describe everything defined in database definition files.
In the definitions:
DbdMenu
interface DbdMenu { int32 getNameLength(); void getName(string name); int16 getNchoices(); int32 getChoiceLength(int16 index); void getChoice(int16 index,string choice); }
DbdLink and DbdDevice
interface DbdSupport { LinkDir getDir(); int32 getChoiceNameLength(); void getChoiceName(string name); int32 getSupportNameLength(); void getSupportName(string name); int32 getDataStructNameLength(); void getDataStructName(string name); } interface DbdLink extends DbdSupport{ LinkSupport create(DbfLink link); } interface DbdDevice extends DbdSupport{ int32 getInterfaceNameLength(); void getInterfaceName(string name); Support create(DbfDevice device); }
DbdStruct and DbdRecord
interface DbdAttribute { int32 getDefaultLength(); void getDefault(string value); boolean isReadonly(); boolean isDesign(); boolean isSpecial(); int16 getAsl(); } interface DbdDefaults {} interface DbdArrayDefaults extends DbdDefaults{ DbfType getType(); int32 getLength();
interface DbdStructDefaults extends DbdDefaults{ DbdStruct getDescription(); }
interface DbdField { int32 getNameLength(); void getName(string name); DbfType getType(); DbdDefaults getDefaults(); DbdAttribute getAttributes(); }
interface DbdStruct { int32 getNameLength(); void getName(string name); int16 getNumberFields(); DbdField getFieldDescription(int16 index); DbdStructLifetime getLifetime(); }
interrface DbdRecord { // Need list of instances int32 getNameLength(); void getName(string name); int16 getNumberFields(); DbdField getFieldDescription(int16 index); DbdRecordSupport getSupport(); DbdRecordLifetime getLifetime(); }
Locate Interfaces
Database Definitions
Classes are available to find and traverse the various Dbd definitons. The implementation will be language specific. For Java they will be something like.
class Dbd<T> implements java.lang.Iterable<T> { public T get(string name); } class DbdLocate { public static Dbd<DbdMenu> getMenu(); public static Dbd<DbdLink> getLink(); public static Dbd<DbdDevice> getDevice(); public static Dbd<DbdStruct> getStruct(); public static Dbd<DbdRecord> getRecord(); }
Then the following can be done
Dbd<DbdMenu> dbdMenu = DbdLocate.getMenu; DbdMenu menu = dbdMenu.get("DisplayLimit"); if(menu!=null) printf("found menu %s\n","DisplayLimit"); Iterator<DbdMenu> iterator = dbdMenu.iterator(); while(iterator.hasNext()) { DbdMenu menu = iterator.next(); String name; menu.getName(name); printf("name is%s\n",name); }
Record Instances
Classes are available to find and traverse record instances. The implementation will be language specific. For Java it will be something like.
class DbInstance implements java.lang.Iterable<RecordInstance> { DbAddr getPV(string name); DbAddr getPV(string recordName, string fieldName); DbAddr getPV(RecordInstance instance, string fieldName); DbAddr getPV(RecordInstance instance,int16 field); DbAddr getIocRecordPV(RecordInstance instance, string fieldName); DbAddr getIocRecordPV(RecordInstance instance,int16 field); } class DbInstanceLocate{ public static DbInstanceLocate get(); }
The following can be done.
DbInstance dbdInstance = DbInstanceLocate.get(); DbAddr dbAddr = dbdInstance.getPV("example.value"); if(dbAddr!=null) printf("found %s\n","example.value"); Iterator<RecordInstance> iterator = dbdInstance.iterator(); while(iterator.hasNext()) { RecordInstance record= iterator.next(); String name; record.getName(name); printf("name is%s\n",name); }
Run Time Interfaces
Record Instance
interface RecordAccess { RecordSupport getRecordSupport(); Dbf getField(string name); }
interface RecordInstance { int32 getNameLength(); void getName(string name); DbdRecord getDescription(); RecordAccess getRecordAccess(); DbdRecord getIocRecordDescription(); RecordAccess getIocRecordAccess(); }
interface DbAddr { RecordInstance getInstance(); Dbf getField(); }
Record, Link, Device Support
Registration and Instance Creation
interface StructFactory { DbfStruct create(); }
interface RecordSupportFactory { RecordSupport create(RecordInstance instance); void destroy(RecordSupport support); }
interface SupportFactory { Support create(Dbf field); }
class RegisterSupport { structure(StructFactory create, string name); record(StructFactory create, string name); link(SupportFactory support,string name); device(SupportFactory support,string name); record(RecordSupportFactory support,string name); }
RegisterSupport is implemented by iocCore. Each struct DBD definition must register a StructFactory to create instances of the structure or record.
Each link, device, and record support must register a SupportFactory to create instances of the support to attach to the link, device, or record instance. During database initialization, iocCore calls the factory methods.
Link/Device Base
interface Support { // base for Link and Device support void report(int16 level); void cancel(); void destroy(); void initialize(); void connect(); void disconnect(); }
Support is the base class for all link and device support. An instance of this is connected to each DbfLink or DbfDevice field. The methods are:
- report - report
- cancel - Cancel any outstanding I/O
- destroy - This is called if the field is being changed after initialization or if the record is being removed.
- initialize - Called to initialize a link.
- connect - Called to connect. Note that this is different than initilization.
- disconnect - disconnect.
Normally record support does not need to call any of the Support methods since Database Access does this automatically. For example if a link or device field is modified via a channel access put, database access will call destroy before modifying the link and initialize and connect after the link is modidied.
Link Support
enum LinkWaitResult { linkNoop, // Nothing was done, e.g. link is null link linkDone, // field was modified. No wait is necessary linkWaitSequential, // waiting. must processes links sequentially linkWaitParallel, // waiting. parallel processing OK }
interface Callback { void done(); void timedout(); }
interface LinkSupport extends Support { void get(Dbf field); LinkWaitResult getWait(Dbf field, double timeout,Callback callback); void put(Dbf field); LinkWaitResult putWait(Dbf field, double timeout,Callback callback); void process(); LinkWaitResult processWait(double timeout,Callback callback); }
LinkSupport supports the following semantics:
- Input Link from another record
- get current value independent of processing state.
- Ask the record to process and wait for completion before fetching value.
- wait until next time record processes then get value. No request is made to process the record.
- Output Link to another record
- put value without requesting that record be processed.
- put value then process record but don't wait for processing to complete.
- put value, process record, and wait for completion
- process link to another record
- request processing but do not wait for completion
- request processing and wait for completion
The Wait methods all return LinkWaitResult.
Device Support
Other than that it must extend Support, nothing is defined for Device support in this document. It will be modeled after the V3 asynDriver support.
Record Support
enum ProcessState { processCancel, processIdle, processInputActive, processActive, processOutputActive, processDone }
interface RecordSupport { void destroy(); void initialize(int32 pass); ProcessState process(ProcessState state); // if special returns false when after is false put fails boolean special(boolean after,Dbf[] field); }
ProcessState supports the following semantics:
- cancel
- If the record is active terminate
Database Access
class DbAccess { void process(RecordInstance instance); void registerDbdSource(Dbf field, Dbf source); }
NOTES:
- This is just the beginning of defining the methods in DbAccess
- registerDbdSource is called by code that manages the strogae for a field.
- The compress record would do this so that it can implement circular buffers.
- Device support for arrays stored in hardware can do this so that data can be extracted in chunks.