18.08.2013 Views

(SYSLIB) Programming Reference Manual - Public Support Login ...

(SYSLIB) Programming Reference Manual - Public Support Login ...

(SYSLIB) Programming Reference Manual - Public Support Login ...

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

AEDIT$–ASCII Image Composition Editing Package<br />

Scientific Format<br />

The scientific format is similar to the fixed decimal format, but it has an exponent at the<br />

right. The exponent consists of an optional exponent character (usually 'E' for singleprecision<br />

and 'D' for double-precision numbers) followed by the exponent's sign (either<br />

"+" or "-") and the exponent's digits. Exponents of single-precision numbers are always<br />

edited as a 2-digit value, and those of double-precision numbers are always edited as a<br />

3–digit value.<br />

The x parameter specifies the total number of character positions to be occupied by the<br />

edited number, including signs, digits, decimal point, and exponent character. If the<br />

edited numbers require more character positions than are specified by the value of x, the<br />

x parameter is ignored and the required character positions are used.<br />

The y parameter specifies the total number of mantissa digits to appear in the edited<br />

number. It includes the digits on both sides of the decimal point but not the decimal<br />

point itself. The placement of the decimal point within the y digits of the mantissa is<br />

determined by the value in the packet cell fps. This is the number of digits to appear to<br />

the left of the decimal point. It is normally set to one.<br />

The floating-point routines provide rounding up to 8 significant digits for single-precision<br />

floating-point numbers and 17 significant digits for double-precision floating-point<br />

numbers. This is because the 2200 single-precision and the double-precision formats<br />

use 27 and 60 bits for the mantissa, respectively. These can represent up to 8 and 18<br />

significant digits in these cases. As rounding is done at a maximum of the 18th digit, the<br />

maximum value of y for which a rounded result will be produced is 8 for single-precision<br />

and 17 for double-precision floating-point numbers. The value of x should allow for the<br />

sign, decimal point, the exponent character, the exponent sign, and the exponent digits.<br />

For example, the following numbers are in scientific format:<br />

8.66E+01 Requires parameter values of x ≥ 8 and y = 3.<br />

-1.3375E-10 Requires parameter values of x ≥ 11 and y = 5.<br />

5.164D+003 Requires parameter values of x ≥ 10 and y = 4.<br />

7833 1733–004 4–15

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!