RFC 0005
Decode Encode Language (DEL)
Network Working Group 4691 RFC-5 Jeff Rulifson June 2, l969 DEL :DEL, 02/06/69 1010:58 JFR ; .DSN=1; .LSP=0; ['=] AND NOT SP ; ['?]; dual transmission? ABSTRACT The Decode-Encode Language (DEL) is a machine independent language tailored to two specific computer network tasks: accepting input codes from interactive consoles, giving immediate feedback, and packing the resulting information into message packets for network transmissin. and accepting message packets from another computer, unpacking them, building trees of display information, and sending other information to the user at his interactive station. This is a working document for the evolution of the DEL language. Comments should be made through Jeff Rulifson at SRI. FORWARD The initial ARPA network working group met at SRI on October 25-26, 1968. It was generally agreed beforehand that the runmning of interactive programs across the network was the first problem that would be faced. This group, already in agreement about the underlaying notions of a DEL-like approach, set down some terminology, expectations for DEL programs, and lists of proposed semantic capability. At the meeting were Andrews, Baray, Carr, Crocker, Rulifson, and Stoughton. A second round of meetings was then held in a piecemeal way. Crocker meet with Rulifson at SRI on November 18, 1968. This resulted in the incorporation of formal co-routines. and Stoughton meet with Rulifson at SRI on Decembeer 12, 1968. It was decided to meet again, as a group, probably at UTAH, in late January 1969. The first public release of this paper was at the BBN NET meeting in Cambridge on February 13, 1969. NET STANDARD TRANSLATORS NST The NST library is the set of programs necessary to mesh efficiently with the code compiled at the user sites from the DEL programs it receives. The NST-DEL approach to NET interactive system communication is intended to operate over a broad spectrum. The lowest level of NST-DEL usage is direct transmission to the server-host, information in the same format that user programs
would receive at the user-host.
In this mode, the NST defaults to inaction. The DEL program
does not receive universal hardware representation input but
input in the normal fashion for the user-host.
And the DEL 1 program becomes merely a message builder and
sender.
A more intermediate use of NST-DEL is to have echo tables for a
TTY at the user-host.
In this mode, the DEL program would run a full duplex TTY for
the user.
It would echo characters, translate them to the character set
of the server-host, pack the translated characters in messages,
and on appropriate break characters send the messages.
When messages come from the server-host, the DEL program would
translate them to the user-host character set and print them on
his TTY.
A more ambitious task for DEL is the operation of large,
display-oriented systems from remote consoles over the NET.
Large interactive systems usually offer a lot of feedback to
the user. The unusual nature of the feedback make it
impossible to model with echo table, and thus a user program
must be activated in a TSS each time a button state is changed.
This puts an unnecessarily large load on a TSS, and if the
system is being run through the NET it could easily load two
systems.
To avoid this double overloading of TSS, a DEL program will
run on the user-host. It will handle all the immediate
feedback, much like a complicated echo table. At appropriate
button pushes, message will be sent to the server-host and
display updates received in return.
One of the more difficult, and often neglected, problems is the
effective simulation of one nonstandard console on another non-
standard console.
We attempt to offer a means of solving this problem through
the co-routine structure of DEL programs. For the
complicated interactive systems, part of the DEL programs
will be constructed by the server-host programmers.
Interfaces between this program and the input stream may
easily be inserted by programmers at the user-host site.
UNIVERSAL HARDWARE REPRESENTATION
To minimize the number of translators needed to map any facility's
user codes to any other facility, there is a universal hardware
representation.
This is simply a way of talking, in general terms, about all the
hardware devices at all the interactive display stations in the initial
network.
For example, a display is thought of as being a square, the
mid-point has coordinates (0.0), the range is -1 to 1 on both
axes. A point may now be specified to any accuracy, regardless of
the particular number of density of rastor points on a display. The representation is discussed in the semantic explanations accompanying the formal description of DEL. INTRODUCTION TO THE NETWORK STANDARD TRANSLATOR (NST) Suppose that a user at a remote site, say Utah, is entered in the AHI system and wants to run NLS. The first step is to enter NLS in the normal way. At that time the Utah system will request a symbolic program from NLS. REP This program is written in DEL. It is called the NLS Remote Encode Program (REP). The program accepts input in the Universal Hardware Representation and translates it to a form usable by NLS. It may pack characters in a buffer, also do some local feedback. When the program is first received at Utah it is compiled and loaded to be run in conjunction with a standard library. All input from the Utah console first goes to the NLS NEP. It is processed, parsed, blocked, translated, etc. When NEP receives a character appropriate to its state it may finally initiate transfers to the 940. The bits transferred are in a form acceptable to the 940, and maybe in a standard form so that the NLSW need not differentiate between Utah and other NET users. ADVANTAGES OF NST After each node has implemented the library part of the NST, it need only write one program for each subsystem, namely the symbolic file it sends to each user that maps the NET hardware representation into its own special bit formats. This is the minimum programming that can be expected if console is used to its fullest extent. Since the NST which runs the encode translation is coded at the user site, it can take advantage of hardware at its consoles to the fullest extent. It can also add or remove hardware features without requiring new or different translation tables from the host. Local users are also kept up to date on any changes in the system offered at the host site. As new features are added, the host programmers change the symbolic encode program. When this new program is compiled and used at the user site, the new features are automatically included. The advantages of having the encode translation programs transferred symbolically should be obvious. Each site can translate any way it sees fit. Thus machine code for each site can be produced to fit that site; faster run times and greater code density will be the result. Moreover, extra symbolic programs, coded at the user site, may be easily interfaced between the user's monitor system and the DEL program from the host machine. This should ease the problem of console extension (e.g. accommodating unusual keys and
buttons) without loss of the flexibility needed for man-machine
interaction.
It is expected that when there is matching hardware, the symbolic
programs will take this into account and avoid any unnecessary
computing. This is immediately possible through the code
translation constructs of DEL. It may someday be possible through
program composition (when Crocker tells us how??)
AHI NLS - USER CONSOLE COMMUNICATION - AN EXAMPLE
BLOCK DIAGRAM
The right side of the picture represents functions done at the
user's main computer; the left side represents those done at the
host computer.
Each label in the picture corresponds to a statement with the
same name.
There are four trails associated with this picture. The first
links (in a forward direction) the labels which are concerned
only with network information. The second links the total
information flow (again in a forward direction). The last two
are equivalent to the first two but in a backward direction.
They may be set with pointers t1 through t4 respectively.
[">tif:] OR I" >nif"]; ["<tif:] OR ["<nif"];
USER-TO-HOST TRANSMISSION
Keyboard is the set of input devices at the user's console.
Input bits from stations, after drifting through levels of monitor
and interrupt handlers, eventually come to the encode translator.
[>nif(encode)]
Encode maps the semi-raw input bits into an input stream in a
form suited to the serving-host subsystem which will process the
input. [>nif(hrt)<nif(keyboard)]
The Encode program was supplied by the server-host subsystem
when the subsystem was first requested. It is sent to the user
machine in symbolic form and is compiled at the user machine
into code particularly suited to that machine.
It may pack to break characters, map multiple characters to
single characters and vice versa, do character translation, and
give immediate feedback to the user.
1 dm Immediate feedback from the encode translator first goes to
local display management, where it is mapped from the NET standard
to the local display hardware.
A wide range of echo output may come from the encode
translator. Simple character echoes would be a minimum, while
command and machine-state feedback will be common.
It is reasonable to expect control and feedback functions not
even done at the server-host user stations to be done in local
display control. For example, people with high-speed displays
may want to selectively clear curves on a Culler display, a
function which is impossible on a storage tube.
Output from the encode translator for the server-host goes to the
invisible IMP, is broken into appropriate sizes and labeled by the
encode translator, and then goes to the NET-to-host translator.
Output from the user may be more than on-line input. It may be
larger items such as computer-generated data, or files
generated and used exclusively at the server-host site but
stored at the user-host site.
Information of this kind may avoid translation, if it is already in
server-host format, or it may undergo yet another kind of translation
if it is a block of data.
hrp It finally gets to the host, and must then go through the
host reception program. This maps and reorders the standard
transmission-style packets of bits sent by the encode programs
into messages acceptable to the host. This program may well be
part of the monitor of the host machine. [>tif(net mode)<nif(code)]
HOST-TO-USER TRANSMISSION
decode Output from the server-host initially goes through decode,
a translation map similar to, and perhaps more complicated than,
the encode map. [>nif(urt)>tif(imp ctrl)<tif(net mode)]
This map at least formats display output into a simplified
logical-entity output stream, of which meaningful pieces may be
dealt with in various ways at the user site.
The Decode program was sent to the host machine at the same
time that the Encode program was sent to the user machine.
The program is initially in symbolic form and is compiled
for efficient running at the host machine.
Lines of charaters should be logically identified so that
different line widths can be handled at the user site.
Some form of logical line identification must also be made.
For example, if a straight line is to be drawn across the
display this fact should be transmitted, rather than a
series of 500 short vectors.
As things firm up, more and more complicated structural
display information (in the manner of LEAP) should be sent
and accommodated at user sites so that the responsibility for
real-time display manipulation may shift closer to the user.
imp ctrl The server-host may also want to send control
information to IMPs. Formatting of this information is done by
the host decoder. [>tif(urt) <tif(decode)]
The other control information supplied by the host decoder is
message break up and identification so that proper assembly and
sorting can be done at the user site.
From the host decoder, information does to the invisible IMP, and
directly to the NET-to-user translator. The only operation done
on the messages is that they may be shuffled.
urt The user reception translator accepts messages from the
user-site IMP 1 and fixes them up for user-site display.
[>nif(d ctrl)>tif(prgm ctrl)<tif(imp ctrl)<nif(decode)]
The minimal action is a reordering of the message pieces.
dctrl For display output, however, more needs to be done. The
NET logical display information must be put in the format of
the user site. Display control does this job. Since it
coordinates between (encode) and (decode) it is able to offer
features of display management local to the user site.
[>nif(display)<nif(urt)]
prgmctrl Another action may be the selective translation and
routing of information to particular user-site subsystems.
[>tif(dctrl)<tif(urt)]
For example, blocks of floating-point information may be
converted to user-style words and sent, in block form, to a
subsystem for processing or storage.
The styles and translation of this information may well be a
compact binary format suitable for quick translation, rather
than a print-image-oriented format.
(display) is the output to the user. [<nif(d ctrl)]
USER-TO-HOST INDIRECT TRANSMISSION
(net mode) This is the mode where a remote user can link to a node
indirectly through another node. [<nif(decode)<tif(hrt)]
DEL SYNTAX
NOTES FOR NLS USERS
All statements in this branch which are not part of the compiler
must end with a period.
To compile the DEL compiler:
Set this pattern for the content analyzer ( (symbol for up arrow)P1
SE(P1) <-"-;). The pointer "del" is on the first character of pattern.
Jump to the first statement of the compiler. The pointer "c"
is on this statement.
And output the compiler to file ( '/A-DEL' ). The pointer "f"
is on the name of the file for the compiler output -
PROGRAMS
SYNTAX
-meta file (k=100.m=300,n=20,s=900)
file = mesdecl $declaration $procedure "FINISH";
procedure =
procname (
(
type "FUNCTION" /
"PROCEDURE" ) .id (type .id / -empty)) /
"CO-ROUTINE") ' /
$declaration labeledst $(labeledst ';) "endp.";
labeledst = ((left arrow symbol).id ': / .empty) statement;
type = "INTEGER" / "REAL" ;
procname = .id;
Functions are differentiated from procedures to aid compilers in
better code production and run time checks.
Functions return values.
Procedures do not return values.
Co-routines do not have names or arguments. Their initial
envocation points are given the pipe declaration.
It is not clear just how global declarations are to be??
DECLARATIONS
SYNTAX
declaration = numbertype / structuredtype / label / lcl2uhr /
uhr2rmt / pipetype;
numbertype = : ("REAL" / "INTEGER") ("CONSTANT" conlist /
varlist);
conlist =
.id '(left arrow symbol)constant
$('. .id '(left arrow symbol)constant);
varlist =
.id ('(left arrow symbol)constant / .empty)
$('. .id('(left arrow symbol)constant / .empty));
idlist = .id $('. .id);
structuredtype = (tree" / "pointer" / "buffer" ) idlist;
label = "LABEL1" idlist;
pipetype = PIPE" pairedids $(', pairedids);
pairedids = .id .id;
procname = .id;
integerv = .id;
pipename = .id;
labelv = .id;
Variables which are declared to be constant, may be put in
read-only memory at run time.
The label declaration is to declare cells which may contain the
machine addresses of labels in the program as their values. This
is not the B5500 label declaration.
In the pipe declaration the first .ID of each pair is the name of the pipe, the second is thke initial starting point for the pipe. ARITHMETIC SYNTAX exp = "IF" conjunct "THEN" exp "ELSE" exp; sum = term ( '+ sum / '- sum / -empty); term = factor ( '* term / '/ term / '(up arrow symbol) term / .empty); factor = '- factor / bitop; bitop = compliment ( '/' bitop / '/'\ bitop / '& bitop / ( .empty); compliment = "--" primary / primary; (symbol for up arrow) means mod. and /\ means exclusive or. Notice that the uniary minus is allowable, and parsed so you can write x*-y. Since there is no standard convention with bitwise operators, they all have the same precedence, and parentheses must be used for grouping. Compliment is the l's compliment. It is assumed that all arithmetic and bit operations take place in the mode and style of the machine running the code. Anyone who takes advantage of word lengths, two's compliment arithmetic, etc. will eventually have problems. PRIMARY SYNTAX primary = constant / builtin /
variable / (
block /
'( exp ');
variable = .id (
'(symbol for left arrow) exp /
'( block ') /
.empty);
constant = integer / real / string;
builtin =
mesinfo /
cortnin /
("MIN" / "MAX") exp $('. exp) '/ ;
parenthesized expressions may be a series of expressions. The
value of a series is the value of the last one executed at run time.
Subroutines may have one call by name argument.
Expressions may be mixed. Strings are a big problem? Rulifson
also wants to get rid of real numbers!!
CONJUNCTIVE EXPRESSION
SYNTAX
conjunct = disjunct ("AND" conjunct / .empty);
disjunct = negation ("OR" negation / .empty);
negation = "NOT" relation / relation;
relation =
'( conjunct ') /
sum (
"<=" sum /
">=" sum /
'< sum /
'> sum /
'= sum /
'" sum /
.empty);
The conjunct construct is rigged in such a way that a conjunct
which is not a sum need not have a value, and may be evaluated
using jumps in the code. Reference to the conjunct is made only
in places where a logical decision is called for (e.g. if and while statements). We hope that most compilers will be smart enough to skip unnecessary evaluations at run time. I.e a conjunct in which the left part is false or a disjunct with the left part true need not have the corresponding right part evaluated. ARITHMETIC EXPRESSION SYNTAX statement = conditional / unconditional; unconditional = loopst / cases / cibtrikst / uist / treest / block / null / exp; conditional = "IF" conjunct "THEN" unconditional ( "ELSE" conditional / .empty); block = "begin" exp $('; exp) "end"; An expressions may be a statement. In conditional statements the else part is optional while in expressions it is mandatory. This is a side effect of the way the left part of the syntax rules are ordered. SEMI-TREE MANIPULATION AND TESTING SYNTAX treest = setpntr / insertpntr / deletepntr; setpntr = "set" "pointer" pntrname "to" pntrexp; pntrexp = direction pntrexp / pntrname; insertpntr = "insert" pntrexp "as" (("left" / "right") "brother") / (("first" / "last: ) "daughter") "of" pntrexp; direction = "up" / "down" / "forward" / "backward: / "head" / "tail"; plantree = "replace" pntrname "with" pntrexp; deletepntr = "delete: pntrname; tree = '( tree1 ') ;
tree1 = nodename $nodename ;
nodename = terminal / '( tree1 ');
terminal = treename / buffername / point ername;
treename = id;
treedecl = "pointer" .id / "tree" .id;
Extra parentheses in tree building results in linear subcategorization,
just as in LISP.
FLOW AND CONTROL
controlst = gost / subst / loopstr / casest;
GO TO STATEMENTS
gost = "GO" "TO" (labelv / .id);
assignlabel = "ASSIGN" .id "TO" labelv;
SUBROUTINES
subst = callst / returnst / cortnout;
callst = "CALL" procname (exp / .emptyu);
returnst = "RETURN" (exp / .empty);
cortnout = "STUFF" exp "IN" pipename;
cortnin = "FETCH" pipename;
FETCH is a builtin function whose value is computed by envoking
the named co-routine.
LOOP STATEMENTS
SYNTAX
loopst = whilest / untilst / forst;
whilest = "WHILE" conjunct "DO" statement;
untilst = "UNTIL" conjunct "DO" statement;
forst = "FOR" integerv '- exp ("BY" exp / .empty) "TO" exp
"DO" statements;
The value of while and until statements is defined to be false
and true (or 0 and non-zero) respectively.
For statements evaluate their initial exp, by part, and to part
once, at initialization time. The running index of for
statements is not available for change within the loop, it may
only be read. If, some compilers can take advantage of this
(say put it in a register) all the better. The increment and
the to bound will both be rounded to integers during the
initialization.
CASE STATEMENTS
SYNTAX
casest = ithcasest / condcasest;
ithcasest = "ITHCASE" exp "OF" "BEGIN" statement $(';
statement) "END";
condcasest = "CASE" exp "OF" "BEGIN" condcs $('; condcs)
"OTHERWISE" statement "END";
condcs = conjunct ': statement;
The value of a case statement is the value of the last case executed.
EXTRA STATEMENTS
null = "NULL";
I/O STATEMENTS
iost = messagest / dspyst ;
MESSAGES
SYNTAX
messagest = buildmes / demand;
buildmest = startmes / appendmes / sendmes;
startmes = "start" "message";
appendmes = "append" "message" "byute" exp;
sendmes = "send" "message";
demandmes = "demand" "Message";
mesinfo =
"get" "message" "byte"
"message1" "length" /
"message" empty: '?;
mesdecl = "message" "bytes" "are" ,byn "bits" long" '..
DISPLAY BUFFERS
SYNTAX
dspyst = startbuffer / bufappend / estab;
startbuffer - "start" "buffer";
bufappend = "append" bufstuff $('& bufstuff);
bufstuff = :
"parameters" dspyparm $('. dspyparm) /
"character" exp /
"string"1 strilng /
"vector" ("from" exp ':exp / .empty) "to" exp '. exp /
"position" (onoff / .empty) "beam" "to" exp '= exp/
curve" ;
dspyparm F :
"intensity" "to" exp /
"character" "width" "to" exp /
"blink" onoff /
"italics" onff;
onoff = "on" / "off";
estab = "establish" buffername;
LOGICAL SCREEN
The screen is taken to be a square. The coordinates are
normalized from -1 to +1 on both axes.
Associated with the screen is a position register, called
PREG. The register is a triple <x.y.r> where x and y
specify a point on the screen and r is a rotation in
radians, counter clockwise, from the x-axis.
The intensity, called INTENSITY, is a real number in the
range from 0 to 1. 0 is black, 1 is as light as your
display can go, and numbers in between specify the relative
log of the intensity difference.
Character frame size.
Blink bit.
BUFFER BUILDING
The terminal nodes of semi-trees are either semi-tree names
or display buffers. A display buffer is a series of logical
entities, called bufstuff.
When the buffer is initilized, it is empty. If no
parameters are initially appended, those in effect at the
end of the display of the last node in the semi-tree will be in
effect for the display of this node.
As the buffer is built, the logical entities are added to it.
When it is established as a buffername, the buffer is
closed, and further appends are prohibited. It is only a
buffername has been established that it may be used in a tree
building statement.
LOGICAL INPUT DEVICES
Wand
Joy Stick
Keyboard
Buttons
Light Pens
Mice
AUDIO OUTPUT DEVICES
.end
SAMPLE PROGRAMS
Program to run display and keyboard as tty.
to run NLS
input part
display part
DEMAND MESSAGE;
While LENGTH " O DO
ITHCASE GETBYTE OF Begin
ITHCASE GETBYTE OF %file area uipdate% BEGIN
%literal area%
%message area%
%name area%
%bug%
%sequence specs%
%filter specs%
%format specs%
%command feedback line%
%filer area%
%date time%
%echo register%
BEGIN %DEL control%
DISTRIBUTION LIST
Steve Carr
Department of Computer Science
University of Utah
Salt Lake City, Utah 84112
Phone 801-322-7211 X8224
Steve Crocker
Boelter Hall
University of California
Los Angeles, California
Phone 213-825-4864
Jeff Rulifson
Stanford Research Institute
333 Ravenswood
Menlo Park, California 94035
Phone 415-326-6200 X4116
Ron Stoughton
Computer Research Laboratory
University of California
Santa Barbara, California 93106
Phone 805-961-3221
Mehmet Baray
Corey Hall
University of California
Berkeley, California 94720
Phone 415-843-2621