Difference between revisions of "EPICS for Dummies"

From Beam Line Controls
Jump to navigation Jump to search
 
(141 intermediate revisions by 2 users not shown)
Line 1: Line 1:


== What is EPICS? ==
== What is EPICS? ==


EPICS (Experimental Physics and Industrial Control System) is a distributed control system, which means that the IOC (software) can run on a different computer as the user interfaces.
EPICS (Experimental Physics and Industrial Control System) is a software control system framework built around programs serving Process Variables (PVs) over a computer network. It is free, open source, and in active development and used in a number of large industrial and research facilities around the world.
EPICS is a distributed control system, which means that the IOC (software) can run on a different computer as the user interfaces.


The next 5 sections are dedicated to the definition of basic EPICS components ([https://wiki-ext.aps.anl.gov/blc/index.php?title=EPICS_for_Dummies#What_is_an_IOC.3F IOC], [https://wiki-ext.aps.anl.gov/blc/index.php?title=EPICS_for_Dummies#What_is_a_PV.3F PV], [https://wiki-ext.aps.anl.gov/blc/index.php?title=EPICS_for_Dummies#What_is_a_record.3F record], [https://wiki-ext.aps.anl.gov/blc/index.php?title=EPICS_for_Dummies#What_is_a_databases.3F database]). To build your own EPICS support, you can skip directly to [https://wiki-ext.aps.anl.gov/blc/index.php?title=IOC_101 How does one create an IOC].




== What is an IOC? ==
== What is an IOC? ==


IOC (Input/Output Controller) is a piece of software running on a computer:
An EPICS '''IOC''' (Input/Output Controller) is a program which processes and serves a '''database'''. A database consists of many '''records''' each with their own '''fields''' which may contain data or change the record behavior. Each of these elements (fields) is known as a '''process variable (PV)'''. Databases may be written from scratch for the IOC or composed from pre-written EPICS '''module''' databases and record types.
* loads '''databases'''
* serves something called '''process variables''' (PVs) that you can read and write to
* used to run on VMEs, but nowadays it runs on anything.
* usually talks to hardware, but that isn’t a requirement.


IOCs are started with startup scripts. Those scripts tell the IOC what database files to load and where those files are. When the IOC is told to load a database, what it is doing is parsing that database file, identifying the records that are contained within, and then generating the actual epics PVs that a user will interact with.
Any client, locally or on the network, can read and/or write a process variable using either '''channel access''' (CA) or '''PVaccess''' (PVA) network protocols. Clients might be another IOC, a GUI display manager (medm/caqtdm/CSS), or any other program with support for the EPICS protocols. Only the name of the process variable (in the form ''prefix:record_name.field_name'') is required to read or write a PV.


'''Records''' and '''databases''' (lists of records) are configuration files describing the initial setup for '''PVs''', the '''IOC''' is the software that manages the behavior of PVs and communication to get/set their values.
Note that:
* IOCs used to run on VMEs, but nowadays it runs on anything.
* IOCs usually talks to hardware, but that isn’t a requirement.


You interact directly with a running IOC via the EPICS shell ('''iocsh'''), or indirectly by reading and writing Process Variables. Starting an IOC on a general purpose computer (a '''softIOC''', as opposed to running on dedicated hardware like VME) involves running a binary along with a startup script of iocsh commands (usually called '''st.cmd''').
This script tells the IOC what database files to load and where those files are. When the IOC is told to load a database, it basically parses that database file, identifying the records that are contained within, and then generating the actual epics PVs that a user will interact with.


 
'''Records''' and '''databases''' (lists of records) are configuration files describing the initial setup for '''PVs''', the '''IOC''' is the software that manages the behavior of PVs and communication to get/set their values.
== What is a databases? ==
 
Databases are lists of records.
 




Line 32: Line 31:


Most of the interactive parts of user displays have PVs associated with them.
Most of the interactive parts of user displays have PVs associated with them.




Line 38: Line 36:


Records are the building blocks of EPICS:
Records are the building blocks of EPICS:
* There is a lot of different types of record, and each type is designed to perform a specific function
* There is a lot of different types of record, and each type is designed to perform a specific function  
* Records are customizable via fields that allow users to configure how they behave and monitor their state.
* Records are customizable via fields that allow users to configure how they behave and monitor their state (see [[#More about record fields]] to know how to learn about record fields)
* Records do nothing until they are processed (see [[#SCAN, PROC & FLNK fields]])
* Records do nothing until they are processed (see [[#SCAN, PROC & FLNK fields]])
* Records vary significantly in complexity (see [[#More about records]])
* Records vary significantly in complexity (see [[#More about records]])
* It is rare for new records to be created, now that asyn device support exists.  '''''add link to asyn?'''''
* It is rare for new records to be created, now that ''asyn'' device support exists <span style="color: red;">add link to asyn?</span>).
 




Line 53: Line 50:
A module is similar to a python package: it is an already written set of databases and associated behavior you can load into your IOC to do certain things, for example talk to specific hardware. An IOC can link to several modules.
A module is similar to a python package: it is an already written set of databases and associated behavior you can load into your IOC to do certain things, for example talk to specific hardware. An IOC can link to several modules.


{| class="wikitable"
{| class="wikitable"  style="margin-left: 100px; margin-right:auto"
|+ Records in synApps modules <br>
|+ Records in synApps modules <br>


Line 79: Line 76:
If a record isn't listed here, it probably comes from EPICS base.  
If a record isn't listed here, it probably comes from EPICS base.  
The advantage to using synApps over a collection of modules one assembles on their own is that some amount of BCDA testing has been done.
The advantage to using synApps over a collection of modules one assembles on their own is that some amount of BCDA testing has been done.




=== What is a record field? ===
=== What is a record field? ===
* A controllable or informative property of a record
* Noteworthy fields:
**'''VAL''' - the default field (used if no field is specified in the vast majority of cases)
**'''SCAN''' - determines when a record processes
**'''NAME''' - the record name (helpful if records are aliased)
**'''DESC''' - record description
**'''RTYP''' - the record type
**'''DTYP''' - the device support type (not meaningful for all record types)
**'''DISP''' - disable puts (ca = channel access & pva = pv access) from outside the IOC (when non-zero); e.g. disable a motor from the motorx_all screen
**'''DISV/DISA/SDIS''' - disable record processing internally
***Record processing is disabled when '''DISA''' equals '''DISV''' (e.g. uses SDIS field to read in a value/mode, which will disable some control if a certain mode is active)
***'''DISA''' is set to the value of the PV in the '''SDIS''' field, if it isn't empty
**'''TPRO''' - trace processing: when set to 1 prints out all the records that get processed after the record is processed; used only for troubleshooting
* Note: some of the fields of a record are actually record attributes (they return the same value for all instances of the record type; see [https://epics.anl.gov/base/R3-16/2-docs/AppDevGuide/DatabaseDefinition.html#x7-2630006.6 https://epics.anl.gov/])


Record fields are controllable or informative properties of a record. For a list of noteworthy fields, see [https://wiki-ext.aps.anl.gov/blc/index.php?title=EPICS_Cheat_Sheet here].


 
==== SCAN, PROC & FLNK fields ====
=== SCAN, PROC & FLNK fields ===


Records do nothing until they are processed. Records can be processed multiple ways:
Records do nothing until they are processed. Records can be processed multiple ways:
* Manually:
* <u>Manually</u>:
** Write 1 (or any non-zero value) to a record’s '''PROC''' field
** Write 1 (or any non-zero value) to a record’s '''PROC''' field
**Forward link ('''FLNK''') from another record
**Forward link ('''FLNK''') from another record
* Periodically:
* <u>Periodically</u> by setting the '''SCAN''' field to something other than <code>Passive</code>
** Set the '''SCAN''' field to something other than <code>Passive</code>
*** <code>Passive</code>
*** <code>Event</code>
*** <code>I/O Intr</code>
*** <code>10 second</code>
*** <code>5 second</code>
*** <code>2 second</code>
*** <code>1 second</code>
*** <code>0.5 second</code>
*** <code>0.2 second</code>
*** <code>0.1 second</code>
** <code>I/O Intr</code> processes a record when the driver gets a new value, but is device/driver dependent and isn’t guaranteed to work
** If a record’s SCAN field is not specified in a database, it defaults to “Passive.” 


{| class="wikitable"  style="margin-left: 100px; margin-right:auto"
|+ SCAN field options <br>


Note: the SCAN field is common to *all* record types and the options can be selected by index instead of by string.
|-
! Index !! Option !! Index !! Option
|-
| 0 || <code>Passive</code>  || 5 || <code>2 second</code>
|-
| 1 || <code>Event</code>    || 6 || <code>1 second</code>
|-
| 2 || <code>I/O Intr</code>  ||7 || <code>0.5 second</code>
|-
| 3 || <code>10 second</code>  ||8 || <code>0.2 second</code>
|-
| 4 || <code>5 second</code>  ||9 || <code>0.1 second</code>
|}


=== How to learn more about record fields? ===
<u>Note</u>:
* If a record’s SCAN field is not specified in a database, it defaults to <code>Passive</code>. 
* The '''SCAN''' field is common to ''all'' record types and the options can be selected by index instead of by string.
* <code>I/O Intr</code> processes a record when the driver gets a new value, but is device/driver dependent and isn’t guaranteed to work
 
 
=== Record link types ===
 
Much of the power of EPICS comes from the ability to link EPICS records together.
There are two link implementations: standard and dynamic. 
* Dynamic links (pink) are found on ''userCalc'' ('''swait''' records) and ''scan'' ('''sscan''' records) screens; this type of link accept only a PV name. THe role of the process command (see below) is taken in a separate field. 
* Standard links (purple) are found everywhere else.
''inlinkHelp'' and ''outlinkHelp'' are accessible from userTransform screens and scaler screens (for the later only).
 
 
==== Input Links ====
 
Input links read a value from another PV. It accepts a PV name followed by a process command (e.g. <code>NPP</code>) and an alarm command (e.g. <code>NMS</code>, ignore this).
Here are the possible process commands for an input link:
* <code>NPP</code> - Just read the value; don't process the target record (i.e. read a potentially stale value); this is a default command.
* <code>PP</code> - Process the target record and then read a value from it.
* <code>CA</code> - Read a value without causing processing to occur.
* <code>CP</code> - Process linking record every time the target record processes.
* <code>CPP</code> - Same as CP, but linking record process only if its SCAN field has the value <code>Passive</code>.
<u>Note</u>: ''inlinkHelp'' is accessible from userTransform screens.
 
 
==== Output Links ====
 
Output links write a value to another PV. It accepts a PV name followed by a process command (e.g. <code>NPP</code>) and an alarm command (e.g. <code>NMS</code>, ignore this).
Here are the possible process commands for an output link:
* <code>NPP</code> - Just write a value; don't process the target record; this is a default command.
* <code>PP</code> - Write a value and then process the target record. To be use if you want EPICS to trace processing (<span style="color: red;">= wait for completion?</span>)
* <code>CA</code> - Write a value; let the target record decide whether or not to process (as it would if you typed the value by hand); if the processing does occur, EPICS will not trace it.
 
<u>Note</u>:
* The default link process command, <code>NPP</code>, is '''almost never the desired behavior''' for output links. Change <code>NPP</code> to <code>PP</code> immediately and revert if problems are discovered.
* If the target PV is itself a link field, you must specify the command <code>CA</code>; if you want to wait for completion in this case, you must use either the '''sseq''' or the '''sCalcout''' record, select <code>CA</code> and set the link's '''WAIT''' field to <code>Wait</code>
* ''outlinkHelp'' is accessible from userTransform and scaler screens.
 
 
==== Forward Links ====
 
Forward link look like output links; they are purple on user displays, but they don't auto-populate with process & alarm commands.
Forward link causes the linked record to process when the record containing the forward link is processed
* Linked record is in the same IOC ('''PROC''' field for linked record is optional):
** <code>record_name.FLNK = linked_record_name</code>
** <code>record_name.FLNK = linked_record_name.PROC</code>
* Linked record is in a different IOC ('''PROC''' field for linked record is required):
** <code>record_name.FLNK = linked_record_name.PROC</code>
 
<u>Note</u>:
* Forwarding-linking records in the same IOC by only specifying the record name is an exception to the "'''VAL''' ''is the default field''" rule.
* When omitting the '''PROC''' field of a linked record in a different IOC, nothing will happen but you won't get any error message.
* Always specify the '''PROC''' field to avoid problems.
 
 
=== More about records ===
 
* Records vary significantly in complexity; one way to classify them would be (*):
** Simple records are associated with individual data types
*::;bi, bo, mbbi, mbbo, longin, longout, ai, ao, stringin, stringout, waveform
** Intermediate records often perform calculations or link multiple records
*::;calcout, scalcout, acalcout, swait, transform, fanout, dfanout
** Complex records are associated with devices or higher-level functionality
*::;motor, scaler, mca, sscan, table, digitel, vs
** Flexible records allow custom functionality to be implemented
*::;sub, aSub, luascript
(*) this is not an official classification, nor an exhaustive list of records.<br><br>
<u>Note</u>:
* areaDetector databases are composed of mostly simple record.
 
 
=== More about record fields ===


To find documentation for a specific field you need to know/find answers to the following questions:
To find documentation for a specific field you need to know/find answers to the following questions:
Line 139: Line 195:
**** <code>/APSshare/epics/synApps_X_Y/support</code>
**** <code>/APSshare/epics/synApps_X_Y/support</code>


=== What is a device? ===
== What is a databases? ==
 
A database is just a text file with a '''.db''' (or '''.template''') extension containing a collection of records that are related.
 
Databases are generalized with macros to allow multiple instances to be loaded (e.g. $(P)):
* Macros are variables containing strings to be substituted when the database is loaded.
* Macros without default values are required to load the database; there is no easy way to figure out what those are for a given database other than looking at the file itself.
* Macros required by the database should match the macros required by associated screens & autosave (.req) files.
* The P (prefix) macro usually includes a colon (:), which is the standard separator used in PV names.
 
 
=== How are databases loaded? ===
 
There are 2 ways to load databases which are strictly equivalent.
 


== More about records ==
==== dbLoadRecords ====


* Records vary significantly in complexity; one way to classify them would be (*):
<code>dbLoadRecords("$(IP)/db/ADAM_4018.db","P=kmp:,R=adam1,PORT=serial1,A=01")</code>
** Simple records are associated with individual data types
<code>dbLoadRecords("$(IP)/db/ADAM_4018.db","P=kmp:,R=adam2,PORT=serial1,A=02")</code>
*::;bi, bo, mbbi, mbbo, longin, longout, ai, ao, stringin, stringout, waveform
 
** Intermediate records often perform calculations or link multiple records
 
*::;calcout, scalcout, acalcout, swait, transform, fanout, dfanout
==== dbLoadTemplate ====
** Complex records are associated with devices or higher-level functionality
 
*::;motor, scaler, mca, sscan, table, digitel, vs
<code>dbLoadTemplate("substitutions/ADAM_4018.substitutions","P=kmp:")</code>
** Flexible records allow custom functionality to be implemented
 
*::;sub, aSub, luascript
where ADAM_4018.substitutions:
(*) this is not an official classification, nor an exhaustive list of records.<br><br>
 
Note that:
<code>file "$(IP)/db/ADAM_4018.db"
* areaDetector databases are composed of mostly simple record.
{
pattern
{R,PORT,A}
{adam1, serial1,01}
{adam2, serial1,02}
}</code>


<br>





Latest revision as of 20:10, 15 March 2023


What is EPICS?

EPICS (Experimental Physics and Industrial Control System) is a software control system framework built around programs serving Process Variables (PVs) over a computer network. It is free, open source, and in active development and used in a number of large industrial and research facilities around the world. EPICS is a distributed control system, which means that the IOC (software) can run on a different computer as the user interfaces.

The next 5 sections are dedicated to the definition of basic EPICS components (IOC, PV, record, database). To build your own EPICS support, you can skip directly to How does one create an IOC.


What is an IOC?

An EPICS IOC (Input/Output Controller) is a program which processes and serves a database. A database consists of many records each with their own fields which may contain data or change the record behavior. Each of these elements (fields) is known as a process variable (PV). Databases may be written from scratch for the IOC or composed from pre-written EPICS module databases and record types.

Any client, locally or on the network, can read and/or write a process variable using either channel access (CA) or PVaccess (PVA) network protocols. Clients might be another IOC, a GUI display manager (medm/caqtdm/CSS), or any other program with support for the EPICS protocols. Only the name of the process variable (in the form prefix:record_name.field_name) is required to read or write a PV.

Note that:

  • IOCs used to run on VMEs, but nowadays it runs on anything.
  • IOCs usually talks to hardware, but that isn’t a requirement.

You interact directly with a running IOC via the EPICS shell (iocsh), or indirectly by reading and writing Process Variables. Starting an IOC on a general purpose computer (a softIOC, as opposed to running on dedicated hardware like VME) involves running a binary along with a startup script of iocsh commands (usually called st.cmd). This script tells the IOC what database files to load and where those files are. When the IOC is told to load a database, it basically parses that database file, identifying the records that are contained within, and then generating the actual epics PVs that a user will interact with.

Records and databases (lists of records) are configuration files describing the initial setup for PVs, the IOC is the software that manages the behavior of PVs and communication to get/set their values.


What is a PV?

PV (Process Variable) is a the field from a record:

PV = record_name + . + field_name

Most of the interactive parts of user displays have PVs associated with them.


What is a record?

Records are the building blocks of EPICS:

  • There is a lot of different types of record, and each type is designed to perform a specific function
  • Records are customizable via fields that allow users to configure how they behave and monitor their state (see #More about record fields to know how to learn about record fields)
  • Records do nothing until they are processed (see #SCAN, PROC & FLNK fields)
  • Records vary significantly in complexity (see #More about records)
  • It is rare for new records to be created, now that asyn device support exists add link to asyn?).


Where do records come from?

Typically, records at the APS comes from either:

  • EPICS base: main core of EPICS
  • synApps: a collection of EPICS modules that are commonly used at the APS

A module is similar to a python package: it is an already written set of databases and associated behavior you can load into your IOC to do certain things, for example talk to specific hardware. An IOC can link to several modules.

Records in synApps modules
Module Records Module Records
alive alive motor motor
asyn asyn optics table
busy busy scaler scaler
calc acalcout, scalcout, sseq, swait, transform sscan sscan
camac camac std epid, timestamp, throttle
lua luascript vac digitel, vs
mca mca vme vme
allenBradley ab1771IFE, ab1771N, ab1771IX, ... allenBradley ..., ab1791, abDcm


If a record isn't listed here, it probably comes from EPICS base. The advantage to using synApps over a collection of modules one assembles on their own is that some amount of BCDA testing has been done.


What is a record field?

Record fields are controllable or informative properties of a record. For a list of noteworthy fields, see here.

SCAN, PROC & FLNK fields

Records do nothing until they are processed. Records can be processed multiple ways:

  • Manually:
    • Write 1 (or any non-zero value) to a record’s PROC field
    • Forward link (FLNK) from another record
  • Periodically by setting the SCAN field to something other than Passive
SCAN field options
Index Option Index Option
0 Passive 5 2 second
1 Event 6 1 second
2 I/O Intr 7 0.5 second
3 10 second 8 0.2 second
4 5 second 9 0.1 second

Note:

  • If a record’s SCAN field is not specified in a database, it defaults to Passive.
  • The SCAN field is common to all record types and the options can be selected by index instead of by string.
  • I/O Intr processes a record when the driver gets a new value, but is device/driver dependent and isn’t guaranteed to work


Record link types

Much of the power of EPICS comes from the ability to link EPICS records together. There are two link implementations: standard and dynamic.

  • Dynamic links (pink) are found on userCalc (swait records) and scan (sscan records) screens; this type of link accept only a PV name. THe role of the process command (see below) is taken in a separate field.
  • Standard links (purple) are found everywhere else.

inlinkHelp and outlinkHelp are accessible from userTransform screens and scaler screens (for the later only).


Input Links

Input links read a value from another PV. It accepts a PV name followed by a process command (e.g. NPP) and an alarm command (e.g. NMS, ignore this). Here are the possible process commands for an input link:

  • NPP - Just read the value; don't process the target record (i.e. read a potentially stale value); this is a default command.
  • PP - Process the target record and then read a value from it.
  • CA - Read a value without causing processing to occur.
  • CP - Process linking record every time the target record processes.
  • CPP - Same as CP, but linking record process only if its SCAN field has the value Passive.

Note: inlinkHelp is accessible from userTransform screens.


Output Links

Output links write a value to another PV. It accepts a PV name followed by a process command (e.g. NPP) and an alarm command (e.g. NMS, ignore this). Here are the possible process commands for an output link:

  • NPP - Just write a value; don't process the target record; this is a default command.
  • PP - Write a value and then process the target record. To be use if you want EPICS to trace processing (= wait for completion?)
  • CA - Write a value; let the target record decide whether or not to process (as it would if you typed the value by hand); if the processing does occur, EPICS will not trace it.

Note:

  • The default link process command, NPP, is almost never the desired behavior for output links. Change NPP to PP immediately and revert if problems are discovered.
  • If the target PV is itself a link field, you must specify the command CA; if you want to wait for completion in this case, you must use either the sseq or the sCalcout record, select CA and set the link's WAIT field to Wait
  • outlinkHelp is accessible from userTransform and scaler screens.


Forward Links

Forward link look like output links; they are purple on user displays, but they don't auto-populate with process & alarm commands. Forward link causes the linked record to process when the record containing the forward link is processed

  • Linked record is in the same IOC (PROC field for linked record is optional):
    • record_name.FLNK = linked_record_name
    • record_name.FLNK = linked_record_name.PROC
  • Linked record is in a different IOC (PROC field for linked record is required):
    • record_name.FLNK = linked_record_name.PROC

Note:

  • Forwarding-linking records in the same IOC by only specifying the record name is an exception to the "VAL is the default field" rule.
  • When omitting the PROC field of a linked record in a different IOC, nothing will happen but you won't get any error message.
  • Always specify the PROC field to avoid problems.


More about records

  • Records vary significantly in complexity; one way to classify them would be (*):
    • Simple records are associated with individual data types
    bi, bo, mbbi, mbbo, longin, longout, ai, ao, stringin, stringout, waveform
    • Intermediate records often perform calculations or link multiple records
    calcout, scalcout, acalcout, swait, transform, fanout, dfanout
    • Complex records are associated with devices or higher-level functionality
    motor, scaler, mca, sscan, table, digitel, vs
    • Flexible records allow custom functionality to be implemented
    sub, aSub, luascript

(*) this is not an official classification, nor an exhaustive list of records.

Note:

  • areaDetector databases are composed of mostly simple record.


More about record fields

To find documentation for a specific field you need to know/find answers to the following questions:

  • Is the field common to all or input/output record types?
  • If not, does the record come from EPICS base or a different EPICS module (synApps)?
    • The EPICS base record reference documentation is the best place to find information about record types that come from EPICS base.
      Field documentation appears in multiple locations:
      • Fields common to all record types
      • Fields common to input record types
      • Fields common to output record types
      • Record-specific documentation
    • synApps record reference documentation

What is a databases?

A database is just a text file with a .db (or .template) extension containing a collection of records that are related.

Databases are generalized with macros to allow multiple instances to be loaded (e.g. $(P)):

  • Macros are variables containing strings to be substituted when the database is loaded.
  • Macros without default values are required to load the database; there is no easy way to figure out what those are for a given database other than looking at the file itself.
  • Macros required by the database should match the macros required by associated screens & autosave (.req) files.
  • The P (prefix) macro usually includes a colon (:), which is the standard separator used in PV names.


How are databases loaded?

There are 2 ways to load databases which are strictly equivalent.


dbLoadRecords

dbLoadRecords("$(IP)/db/ADAM_4018.db","P=kmp:,R=adam1,PORT=serial1,A=01")
dbLoadRecords("$(IP)/db/ADAM_4018.db","P=kmp:,R=adam2,PORT=serial1,A=02")


dbLoadTemplate

dbLoadTemplate("substitutions/ADAM_4018.substitutions","P=kmp:")

where ADAM_4018.substitutions:

file "$(IP)/db/ADAM_4018.db"
{
pattern
{R,PORT,A}
{adam1, serial1,01}
{adam2, serial1,02}
}


External links