View Old View New View Both View Only Previous Next

This draft contains only sections that have differences from the version that it modified.

W3C

XPath and XQuery Functions and Operators 4.0

W3C Editor's Draft 2 February 2026

This version:
https://qt4cg.org/specifications/xpath-functions-40/
Latest version of XPath and XQuery Functions and Operators 4.0:
https://qt4cg.org/specifications/xpath-functions-40/
Most recent Recommendation of XPath and XQuery Functions and Operators:
https://www.w3.org/TR/2017/REC-xpath-functions-31-20170321/
Editor:
Michael Kay, Saxonica <http://www.saxonica.com/>

This document is also available in these non-normative formats: Specification in XML format and XML function catalog.


Abstract

This document defines constructor functions, operators, and functions on the datatypes defined in [XML Schema Part 2: Datatypes Second Edition] and the datatypes defined in [XQuery and XPath Data Model (XDM) 4.0]. It also defines functions and operators on nodes and node sequences as defined in the [XQuery and XPath Data Model (XDM) 4.0]. These functions and operators are defined for use in [XML Path Language (XPath) 4.0] and [XQuery 4.0: An XML Query Language] and [XSL Transformations (XSLT) Version 4.0] and other related XML standards. The signatures and summaries of functions defined in this document are available at: http://www.w3.org/2005/xpath-functions/.

A summary of changes since version 3.1 is provided at H Changes since 3.1.

Status of this Document

This section describes the status of this document at the time of its publication. Other documents may supersede this document.

This document is a working draft developed and maintained by a W3C Community Group, the XQuery and XSLT Extensions Community Group unofficially known as QT4CG (where "QT" denotes Query and Transformation). This draft is work in progress and should not be considered either stable or complete. Standard W3C copyright and patent conditions apply.

The community group welcomes comments on the specification. Comments are best submitted as issues on the group's GitHub repository.

The community group maintains two extensive test suites, one oriented to XQuery and XPath, the other to XSLT. These can be found at qt4tests and xslt40-test respectively. New tests, or suggestions for correcting existing tests, are welcome. The test suites include extensive metadata describing the conditions for applicability of each test case as well as the expected results. They do not include any test drivers for executing the tests: each implementation is expected to provide its own test driver.

Dedication

The publications of this community group are dedicated to our co-chair, Michael Sperberg-McQueen (1954–2024).


1 Introduction

Changes in 4.0 (next)

  1. If a section of this specification has been updated since version 3.1, an overview of the changes is provided, along with links to navigate to the next or previous change.

  2. Sections with significant changes are marked with a ✭ symbol in the table of contents. New functions are indicated by ✚.

The purpose of this document is to define functions and operators for inclusion in XPath 4.0, XQuery 4.0, and XSLT 4.0. The exact syntax used to call these functions and operators is specified in [XML Path Language (XPath) 4.0], [XQuery 4.0: An XML Query Language] and [XSL Transformations (XSLT) Version 4.0].

This document defines three classes of functions:

[XML Schema Part 2: Datatypes Second Edition] defines a number of primitive and derived datatypes, collectively known as built-in datatypes. This document defines functions and operations on these datatypes as well as the other types (for example, nodes and sequences of nodes) defined in 2.7 Schema Information DM31 of the [XQuery and XPath Data Model (XDM) 4.0]. These functions and operations are available for use in [XML Path Language (XPath) 4.0], [XQuery 4.0: An XML Query Language] and any other host language that chooses to reference them. In particular, they may be referenced in future versions of XSLT and related XML standards.

[XSD 1.1 Part 2] adds to the datatypes defined in [XML Schema Part 2: Datatypes Second Edition]. It introduces a new derived type xs:dateTimeStamp, and it incorporates as built-in types the two types xs:yearMonthDuration and xs:dayTimeDuration which were previously XDM additions to the type system. In addition, XSD 1.1 clarifies and updates many aspects of the definitions of the existing datatypes: for example, it extends the value space of xs:double to allow both positive and negative zero, and extends the lexical space to allow +INF; it modifies the value space of xs:Name to permit additional Unicode characters; it allows year zero and disallows leap seconds in xs:dateTime values; and it allows any character string to appear as the value of an xs:anyURI item. Implementations of this specification may support either XSD 1.0 or XSD 1.1 or both.

In some cases, this specification references XSD for the semantics of operations such as the effect of matching using regular expressions, or conversion of atomic items to strings. In most such cases there is no intended technical difference between the XSD 1.0 and XSD 1.1 specifications, but the 1.1 version often provides clearer explanations and sometimes also corrects technical errors. In such cases this specification often chooses to reference the XSD 1.1 specification. This should not be taken as implying that it is necessary to invoke an XSD 1.1 processor.

References to specific sections of some of the above documents are indicated by cross-document links in this document. Each such link consists of a pointer to a specific section followed a superscript specifying the linked document. The superscripts have the following meanings: XQ [XQuery 4.0: An XML Query Language], XT [XSL Transformations (XSLT) Version 4.0], XP [XML Path Language (XPath) 4.0], and DM [XQuery and XPath Data Model (XDM) 4.0].

1.5 Function signatures and descriptions

Each function (or group of functions having the same name) is defined in this specification using a standard proforma. This has the following sections:

1.5.3 Function signature

Each function is then defined by specifying its signature(s), which define the types of the parameters and of the result value.

Where functions take a variable number of arguments, two conventions are used:a single function signature is used giving default values for those parameters that can be omitted.

  • Wherever possible, a single function signature is used giving default values for those parameters that can be omitted.

  • If this is not possible, because the effect of omitting a parameter cannot be specified by giving a default value, multiple signatures are given for the function.

Each function signature is presented in a form like this:

fn:function-name(
$parameter-nameas parameter-type,
$...as 
) as return-type

In this notation, function-name, in bold-face, is the local name of the function whose signature is being specified. The prefix fn indicates that the function is in the namespace http://www.w3.org/2005/xpath-functions: this is one of the conventional prefixes listed in 1.3 Namespaces and prefixes. If the function takes no parameters, then the name is followed by an empty parameter list: (); otherwise, the name is followed by a parenthesized list of parameter declarations. Each parameter declaration includes:

  • The name of the parameter (which in 4.0 is significant because it can be used as a keyword in a function call)

  • The static type of the parameter (in italics)

  • If the parameter is optional, then an expression giving the default value (preceded by the symbol :=).

    The default value expression is evaluated using the static and dynamic context of the function caller (or of a named function reference). For example, if the default value is given as ., then it evaluates to the context value from the dynamic context of the function caller; if it is given as default-collation, then its value is the default collation from the static context of the function caller; if it is given as deep-equal#2, then the third argument supplied to deep-equal is the default collation from the static context of the caller.

If there are two or more parameter declarations, they are separated by a comma.

The return-type, also in italics, specifies the static type of the value returned by the function. The dynamic type of the value returned by the function is the same as its static type or derived from the static type. All parameter types and return types are specified using the SequenceType notation defined in 2.5.4 SequenceType Syntax XP31.

1.6 Function calls

Rules for evaluating the operands of operators are described in the relevant sections of [XQuery 4.0: An XML Query Language] and [XML Path Language (XPath) 4.0]. For example, the rules for evaluating the operands of arithmetic operators are described in 3.5 Arithmetic Expressions XP31. Specifically, rules for parameters of type xs:untypedAtomic and the empty sequence are specified in this section.

For function calls, the required type of an argument is defined in the function signature of each function, and the way in which a supplied value is converted to the required type (or rejected if it cannot be converted) is defined by the coercion rulesXP.

Some functions accept a single value or the empty sequence as an argument and some may return a single value or the empty sequence. This is indicated in the function signature by following the parameter or return type name with a question mark: ?, indicating that either a single value or the empty sequence must appear. See below.

fn:function-name(
$parameter-nameas parameter-type
) as return-type?

Note that this function signature is different from a signature in which the parameter is omitted. See, for example, the two signatures for fn:string. In the first signature, the parameter is omitted and the argument defaults to the context value, referred to as .. In the second signature, the argument must be present but may be the empty sequence, written as ().

Some functions accept a sequence of zero or more values as an argument. This is indicated by following the name of the type of the items in the sequence with *. The sequence may contain zero or more items of the named type. For example, the function below accepts a sequence of xs:double and returns a xs:double or the empty sequence.

fn:median(
$argas xs:double*
) as xs:double?

In XPath 4.0, the arguments in a function call can be supplied by keyword as an alternative to supplying them positionally. For example the call resolve-uri(@href, static-base-uri()) can now be written resolve-uri(base := static-base-uri(), relativehref := @href). The order in which arguments are supplied can therefore differ from the order in which they are declared. The specification, however, continues to use phrases such as “the second argument” as a convenient shorthand for "the value of the argument that is bound to the second parameter declaration".

In addition, default values have been added with XPath 4.0. If a function signature in this specification defines a default value, the effective value is chosen as follows:

  1. If a value is supplied that matches the parameter type, this value is chosen.

  2. Otherwise, if no value is supplied, or if the supplied value is an empty sequence, the default value is chosen.

  3. Otherwise, a type error [err:XPTY0004]XP is raised.

2 Processing sequences

A sequence is an ordered collection of zero or more items. An item is a node, an atomic item, or a function, such as a map or an array. The terms sequence and item are defined formally in [XQuery 4.0: An XML Query Language] and [XML Path Language (XPath) 4.0].

2.1 General functions on sequences

The following functions are defined on sequences. These functions work on any sequence, without performing any operations that are sensitive to the individual items in the sequence.

FunctionMeaning
fn:emptyReturns true if the argument is the empty sequence.
fn:existsReturns true if the argument is a non-empty sequence.
fn:footReturns the last item in a sequence.
fn:headReturns the first item in a sequence.
fn:identityReturns its argument value.
fn:insert-beforeReturns a sequence constructed by inserting an item or a sequence of items at a given position within an existing sequence.
fn:items-atReturns a sequence containing the items from $input at positions defined by $at, in the order specified.
fn:removeReturns a new sequence containing all the items of $inputexcept those at specified positions.
fn:replicateProduces multiple copies of a sequence.
fn:reverseReverses the order of items in a sequence.
fn:sequence-joinInserts a separator between adjacent items in a sequence.
fn:sliceReturns a sequence containing selected items from a supplied input sequence based on their position.
fn:subsequenceReturns the contiguous sequence of items in $input beginning at the position indicated by $start and continuing for the number of items indicated by $length.
fn:tailReturns all but the first item in a sequence.
fn:trunkReturns all but the last item in a sequence.
fn:unorderedReturns the items of $input in an implementation-dependent order.
fn:voidAbsorbs the argument.

As in the previous section, for the illustrative examples below, assume an XQuery or transformation operating on a non-empty Purchase Order document containing a number of line-item elements. The variable $seq is bound to the sequence of line-item nodes in document order. The variables $item1, $item2, etc. are bound to separate, individual line-item nodes in the sequence.

2.1.12 fn:slice

Changes in 4.0 (next | previous)

  1. New in 4.0

Summary

Returns a sequence containing selected items from a supplied input sequence based on their position.

Signature
fn:slice(
$inputas item()*,
$startas xs:integer?:= ()0,
$endas xs:integer?:= ()0,
$stepas xs:integer?:= ()0
) as item()*
Properties

This function is deterministic, context-independent, and focus-independent.

Rules

If $input is the empty sequence, the function returns the empty sequence.

Let $S be the first of the following that applies:

  • If $start is absent, empty, or zero, then 1.

  • If $start is negative, then fn:count($input) + $start + 1.

  • Otherwise, $start.

Let $E be the first of the following that applies:

  • If $end is absent, empty, or zero, then fn:count($input).

  • If $end is negative, then fn:count($input) + $end + 1.

  • Otherwise, $end.

Let $STEP be the first of the following that applies:

  • If $step is absent, empty, or zero, then:

    • If $E ge $S, then +1

    • Otherwise -1

  • Otherwise, $step.

If $STEP is negative, the function returns $input => fn:reverse() => fn:slice(-$S, -$E, -$STEP).

Otherwise the function returns the result of the expression:

$input[position() ge $S and position() le $E and (position() - $S) mod $STEP eq 0]
Editorial note 
TBA: define formal equivalent.
Notes

The function is inspired by the slice operators in Javascript and Python, but it differs in detail to accommodate the tradition of 1-based addressing in XPath. The end position is inclusive rather than exclusive, so that in the simple case where $start and $end are positive and $end > $start, fn:slice($in, $start, $end) returns the same result as $in[position() = $start to $end].

This function can be used to enhance the RangeExpression, defined in [XML Path Language (XPath) 4.0] section 4.8.2 Range Expressions, to construct a sequence of integers based on steps other than 1.

Examples
Variables
let $in := ('a', 'b', 'c', 'd', 'e')
ExpressionResult
slice($in, start := 2, end := 4)

"b", "c", "d"

slice($in, start := 2)

"b", "c", "d", "e"

slice($in, end := 2)

"a", "b"

slice($in, start := 3, end := 3)

"c"

slice($in, start := 4, end := 3)

"d", "c"

slice($in, start := 2, end := 5, step := 2)

"b", "d"

slice($in, start := 5, end := 2, step := -2)

"e", "c"

slice($in, start := 2, end := 5, step := -2)

()

slice($in, start := 5, end := 2, step := 2)

()

slice($in)

"a", "b", "c", "d", "e"

slice($in, start := -1)

"e"

slice($in, start := -3)

"c", "d", "e"

slice($in, end := -2)

"a", "b", "c", "d"

slice($in, start := 2, end := -2)

"b", "c", "d"

slice($in, start := -2, end := 2)

"d", "c", "b"

slice($in, start := -4, end := -2)

"b", "c", "d"

slice($in, start := -2, end := -4)

"d", "c", "b"

slice($in, start := -4, end := -2, step := 2)

"b", "d"

slice($in, start := -2, end := -4, step := -2)

"d", "b"

slice(("a", "b", "c", "d"), 0)

"a", "b", "c", "d"

slice((1 to 5), step := 2)

1, 3, 5

2.1.13 fn:subsequence

Changes in 4.0 (next | previous)

  1. The optional third argument can now be supplied as an empty sequence.  [Issue 895 PR 901 16 December 2023]

Summary

Returns the contiguous sequence of items in $input beginning at the position indicated by $start and continuing for the number of items indicated by $length.

Signature
fn:subsequence(
$inputas item()*,
$startas xs:double,
$lengthas xs:double?:= ()
) as item()*
Properties

This function is deterministic, context-independent, and focus-independent.

Rules

In the two-argument caseIf the (or where the third argument is anthe empty sequence), the function returns:

$input[round($start) le position()]

In the three-argument caseOtherwise, the function returns:

$input[round($start) le position() 
         and position() lt round($start) + round($length)]
$input[round($start) le position() and
       position() lt round($start) + round($length)]
Formal Equivalent

The effect of the function is equivalent to the result of the following XPath expression.

filter(
  $input,
  if (empty($length)) then (
    fn($item, $pos) { round($start) le $pos }
  ) else (
    fn($item, $pos) { round($start) le $pos and $pos lt round($start) + round($length) }
  )
)
Notes

The first item of a sequence is located at position 1, not position 0.

If $input is the empty sequence, the empty sequence is returned.

In the two-argument case, the function returns a sequence comprising those items of $input whose 1-based position is greater than or equal to $start (rounded to an integer). No error occurs if $start is zero or negative.

In the three-argument case, The function returns a sequence comprising those items of $input whose 1-based position is greater than or equal to $start (rounded to an integer), and less than the sum of $start and $length (both rounded to integers). No error occurs if $start is zero or negative, or if $start plus $length exceeds the number of items in the sequence, or if $length is negative.

As a consequence of the general rules, if $start is -INF and $length is +INF, then fn:round($start) + fn:round($length) is NaN; since position() lt NaN always returns false, the result is an empty sequence.

The reason the function accepts arguments of type xs:double is that many computations on untyped data return an xs:double result; and the reason for the rounding rules is to compensate for any imprecision in these floating-point computations.

Examples
Variables
let $seq := ("item1", "item2", "item3", "item4", "item5")
ExpressionResult
subsequence($seq, 4)

"item4", "item5"

subsequence($seq, 3, 2)

"item3", "item4"

2.2 Comparison functions

The functions in this section perform comparisons between the items in one or more sequences.

Many of these functions require atomic items to be compared for equality.

[Definition] Two atomic items A and B are said to be contextually equal if the function call fn:compare(A, B) returns zero when evaluated with a specified or context-determined collation and implicit timezone. If two values are not contextually equal, they are considered to be contextually unequal, even in the case when comparing them using fn:compare raises an error.

Note:

Except where explicitly stated otherwise, an appeal to contextual equality implies that NaN is treated as equal to NaN.

FunctionMeaning
fn:atomic-equalDetermines whether two atomic items are equal, under the rules used for comparing keys in a map.
fn:compareReturns -1, 0, or 1, depending on whether the first value is less than, equal to, or greater than the second value.
fn:contains-subsequenceDetermines whether one sequence contains another as a contiguous subsequence, using a supplied callback function to compare items.
fn:deep-equal This function assesses whether two sequences are deep-equal to each other. To be deep-equal, they must contain items that are pairwise deep-equal; and for two items to be deep-equal, they must either be atomic items that compare equal, or nodes of the same kind, with the same name, whose children are deep-equal, or maps with matching entries, or arrays with matching members.
fn:distinct-valuesReturns the values that appear in a sequence, with duplicates eliminated.
fn:duplicate-valuesReturns the values that appear in a sequence more than once.
fn:ends-with-subsequenceDetermines whether one sequence ends with another, using a supplied callback function to compare items.
fn:index-ofReturns a sequence of positive integers giving the positions within the sequence $input of items that are contextually equal to $target.
fn:starts-with-subsequenceDetermines whether one sequence starts with another, using a supplied callback function to compare items.

2.2.2 fn:compare

Changes in 4.0 (next | previous)

  1. The function has been expanded in scope to handle comparison of values other than strings.  [Issue 893 PR 909 10 January 2024]

  2. The spec has been corrected to note that the function depends on the implicit timezone.  [Issue 1608 PR 1611 26 November 2024]

Summary

Returns -1, 0, or 1, depending on whether the first value is less than, equal to, or greater than the second value.

Signature
fn:compare(
$value1as xs:anyAtomicType?,
$value2as xs:anyAtomicType?,
$collationas xs:string?:= fn:default-collation()
) as xs:integer?
Properties

The two-argument form of this function is deterministic, context-dependent, and focus-independent. It depends on collations, and implicit timezone.

The three-argument form of this function is deterministic, context-dependent, and focus-independent. It depends on collations, and implicit timezone, and static base URI.

Rules

The function compares two atomic items $value1 and $value2 for order, and returns the integer value -1, 0, or +1, depending on whether $value1 is less than, equal to, or greater than $value2, respectively.

This function is transitive and symmetric. For example:

  • If compare(A, B) returns zero, then compare(B, A) returns zero.

  • If compare(A, B) returns -1, then compare(B, A) returns +1.

  • If compare(A, B) and compare(B, C) both return -1, then compare(A, C) also returns -1.

If either $value1 or $value2 is the empty sequence, the function returns the empty sequence.

Otherwise, the result is determined as follows:

  1. If $value1 is an instance of xs:string, xs:anyURI or xs:untypedAtomic, and if $value2 is an instance of xs:string, xs:anyURI or xs:untypedAtomic, the values are compared as strings, and the result reflects the order according to the rules of the collation that is used.

    The collation is determined according to the rules in 5.3.7 Choosing a collation.

    Note:

    Using the default collation may be inappropriate for some strings, for example URIs or manufacturing part numbers. In such cases it is safest to supply "http://www.w3.org/2005/xpath-functions/collation/codepoint" explicitly as the third argument.

  2. If both $value1 and $value2 are instances of xs:numeric, the function relies on a total order, which is defined as follows:

    1. A value $f of type xs:float is in all cases equal to the value xs:double($f). The remaining rules therefore only consider instances of xs:double and xs:decimal.

    2. NaN is equal to itself and less than any other value.

    3. Negative infinity is equal to itself and less than any other value except NaN.

    4. Positive infinity is equal to itself and greater than any other value.

    5. Negative zero is equal to positive zero.

    6. Other xs:double and xs:decimal values (that is, values other than the infinities, NaN, and negative zero) are ordered according to their mathematical magnitude, the comparison being done without any rounding or loss of precision. This effect can be achieved by converting xs:double values to xs:decimal using an implementation of xs:decimal that imposes no limits on precision or scale, or an implementation whose limits are such that all xs:double values can be represented precisely.

    Note:

    Every xs:double other than NaN and ±INF, has a mathematical value of the form m × 2^e, where m is an integer whose absolute value is less than 2^53, and e is an integer between -1075 and 970, inclusive. This is the value that is used in comparisons.

    Practical difficulties arise because the typical string representations of an xs:double, such as 3.1, cannot be precisely represented by values of the form m × 2^e, but are instead converted to the best available approximation, which will often not be exactly equal to an xs:decimal expressed using the same lexical form.

  3. If both $value1 and $value2 are instances of xs:boolean, the result is fn:compare(xs:integer($value1), xs:integer($value2))

    Note:

    This means that false is treated as less than true.

  4. If $value1 is an instance of xs:hexBinary or xs:base64Binary, and if $value2 is an instance of xs:hexBinary or xs:base64Binary, then:

    1. Let $A be the sequence of integers, in the range (0 to 255), representing the octets of $value1, in order; and let $B similarly be the sequence of integers representing the octets of $value2.

    2. If $A is empty and $B is empty return zero.

    3. If $A is empty and $B is not empty return -1.

    4. Let $C be the value of fn:compare(fn:head($A), fn:head($B)).

    5. If $C is non-zero, then return $C.

    6. Otherwise, return the result of applying these rules recursively to fn:tail($A) and fn:tail($B)

  5. If both $value1 and $value2 are instances of the same primitive type T, where T is one of the types xs:dateTime, xs:date, xs:time, xs:gYear, xs:gYearMonth, xs:gMonth, gMonthDay, or gDay, then:

    1. Each of the values is converted to an xs:dateTime value as follows:

      1. The value is considered as a tuple with seven fields (year, month, day, hours, minutes, seconds, timezone) as defined by the functions fn:year-from-dateTime, fn:months-from-dateTime, and so on.

      2. Any absent components, other than the timezone, are substituted with the corresponding components of the (arbitrary) xs:dateTime value 1972-01-01T00:00:00 to produce an xs:dateTime value.

      3. If the timezone component is absent, it is substituted with the implicit timezone from the dynamic context.

    2. The result of the function is then the result of comparing the starting instants of these two xs:dateTime values according to the algorithm defined in section 3.2.7.4 of [XML Schema Part 2: Datatypes Second Edition] ( “Order relation on dateTime” for xs:dateTime values with timezones).

  6. If both $value1 and $value2 are instances of xs:duration, then:

    1. Let $M1 and $M2 be the months components of the two durations, and let $S1 and $S2 be the seconds components of the two durations.

    2. Let $C be fn:compare($M1, $M2).

    3. If $C is non-zero, return $C.

    4. Otherwise, return fn:compare($S1, $S2).

    Note:

    The result matches the real-world semantics of durations in many cases, for example:

    • When both values are zero-length durations.

    • When both values are have an equal months component (in particular when both have a zero months component).

    • When both values are have an equal seconds component (in particular when both have a zero seconds component).

    • When both values have a seconds component that is less than the number of seconds in the shortest month.

    In other cases the result is well defined and well behaved (for example it is symmetric and transitive) but may be counter-intuitive. For example, one month (PT1M) is considered greater than one hundred days (PT100D).

    Previous versions of this specification allowed durations to be compared only if both were instances of xs:dateTimeDuration or xs:yearMonthDuration. This requirement has been relaxed in the interests of allowing all atomic items to be sorted; in some applications the actual sort order matters little, so long as it is consistent.

  7. If both $value1 and $value2 are instances of xs:QName, then:

    1. Let $N1 and $N2 be the result of applying the function fn:namespace-uri-from-QName to the two values, and let $L1 and $L2 be the result of applying the function local-name-from-QName to the two values.

    2. Let $CPC be "http://www.w3.org/2005/xpath-functions/collation/codepoint".

    3. Let $C be fn:compare($N1, $N2, $CPC).

    4. If $C is non-zero, return $C.

    5. Otherwise, return fn:compare($L1, $L2, $CPC).

  8. If both $value1 and $value2 are instances of xs:NOTATION, return fn:compare(xs:QName($value1), xs:QName($value2)).

  9. For any other combination of types, a type error [err:XPTY0004]XP is raised. In particular, this means that an error is raised when comparing two atomic items that belong to different [XQuery and XPath Data Model (XDM) 4.0] section .

Notes

For numeric values, consider the xs:double value written as 0.1e0 and the xs:decimal value written as 0.1: The mathematical magnitude of this xs:double value is 0.1000000000000000055511151231257827021181583404541015625. Therefore, compare(0.1e0, 0.1) returns +1. By contrast, 0.1e0 lt 0.1 is false and 0.1e0 eq 0.1 is true, because those expressions convert the xs:decimal value 0.1 to the xs:double value 0.1e0 before the comparison.

Although operations such as sorting and the fn:min and fn:max functions invoke fn:compare to perform numeric comparison, these functions in some cases treat NaN differently.

Examples
Expression:

compare('abc', 'abc')

Result:

0

Expression:

compare('Strasse', 'Straße')

Result:

-1

Expression:

compare('Strasse', 'Straße')

Result:

0

(Assuming the default collation equates “ss” and the German letter “ß”.)

Expression:
compare(
  'Strasse',
  'Straße',
  collation({ 'lang': 'de', 'strength': 'primary' })
)
Result:
0

(The specified collation equates “ss” and the German letter “ß”.)

Expression:

compare('text', parse-xml('<xml>text</xml>'))

Result:

0

Expression:

compare(9, 10)

Result:

-1

Expression:

compare(123, 123.0)

Result:

0

Expression:

compare(xs:double('NaN'), xs:float('NaN'))

Result:

0

Expression:

compare(xs:double('NaN'), xs:double('-INF'))

Result:

-1

Expression:

compare(xs:double('-INF'), -23)

Result:

-1

Expression:

compare(1, 1e0)

Result:

0

Expression:

compare(1.1, 1.1e0)

Result:

-1

Expression:

compare(1.2, 1.2e0)

Result:

+1

Expression:

compare(9999, xs:double('INF'))

Result:

-1

Expression:

compare(false(), true())

Result:

-1

Expression:

compare(xs:hexBinary(''), xs:base64Binary(''))

Result:

0

Expression:

compare(xs:hexBinary('0001'), xs:hexBinary('0002'))

Result:

-1

Expression:

compare(xs:hexBinary('00FF'), xs:hexBinary('FF'))

Result:

-1

Expression:

compare(xs:time('23:59:59'), xs:time('00:00:00'))

Result:

1

Expression:

compare(xs:time('12:00:00Z'), xs:time('13:00:00+01:00'))

Result:

0

Expression:

compare(xs:date('2001-01-01+01:00'), xs:date('2001-01-01+00:00'))

Result:

-1

Expression:

compare(xs:duration('P1Y'), xs:duration('P13M'))

Result:

-1

Expression:

compare(xs:duration('P1Y'), xs:duration('P1Y3M4D'))

Result:

-1

Expression:

compare(xs:duration('P1Y'), xs:duration('P1000D'))

Result:

+1

Expression:

compare(#space, #xml:space)

Result:

-1

Expression:

compare(#Q{http://example.com/ns}index, #Q{http://example.com/ns}xmp:index)

Result:

0

2.2.3 fn:contains-subsequence

Changes in 4.0 (next | previous)

  1. New in 4.0  [Issue 92 PR 222 1 November 2022]

Summary

Determines whether one sequence contains another as a contiguous subsequence, using a supplied callback function to compare items.

Signature
fn:contains-subsequence(
$inputas item()*,
$subsequenceas item()*,
$compareas (fn(item(), item()) as xs:boolean?)?:= fn:deep-equal#2
) as xs:boolean
Properties

The two-argument form of this function is deterministic, context-dependent, and focus-independent. It depends on collations, and implicit timezone.

The three-argument form of this function is deterministic, context-independent, and focus-independent.

Rules

Informally, the function returns true if $input contains a consecutive subsequence matching $subsequence, when items are compared using the supplied (or default) $compare function.

Formal Equivalent

The effect of the function is equivalent to the result of the following XPath expression.

some $i in 0 to count($input) - count($subsequence)
satisfies (
  every $j in 1 to count($subsequence)
  satisfies $compare($input[$i + $j], $subsequence[$j])   
)
Notes

There is no requirement that the $compare function should have the traditional qualities of equality comparison. The result is well-defined, for example, even if $compare is not transitive or not symmetric.

A return value of () from the function is treated as false.

Examples
Expression:

contains-subsequence((), ())

Result:

true()

Expression:

contains-subsequence(1 to 10, 3 to 6)

Result:

true()

Expression:

contains-subsequence(1 to 10, (2, 4, 6))

Result:

false()

Expression:

contains-subsequence(1 to 10, ())

Result:

true()

Expression:

contains-subsequence(1 to 10, 1 to 10)

Result:

true()

Expression:

contains-subsequence(1 to 10, 5)

Result:

true()

Expression:
contains-subsequence(
  1 to 10,
  103 to 105,
  fn($x, $y) { $x mod 100 = $y mod 100 }
)
Result:
true()
Expression:
contains-subsequence(
  ("A", "B", "C", "D"),
  ("b", "c"),
  fn($x, $y) {
    compare(
      $x,
      $y,
      "http://www.w3.org/2005/xpath-functions/collation/html-ascii-case-insensitive"
    ) eq 0
  }
)
Result:
true()
Expression:
let $chap := parse-xml("<doc><chap><h1/><p/><p/><footnote/></chap></doc>")//chap
return contains-subsequence(
  $chap ! child::*,
  $chap ! child::p,
  op("is")
)
Result:
true()

(True because the p children of the chap element form a contiguous subsequence.)

Expression:

contains-subsequence(10 to 20, (5, 3, 1), op("gt"))

Result:

true()

Expression:
contains-subsequence(
  ("Alpha", "Beta", "Gamma", "Delta"), ("B", "G"),
  starts-with#2
)
Result:
true()
Expression:
contains-subsequence(
  ("Zero", "Alpha", "Beta", "Gamma", "Delta", "Epsilon"),
  1 to 4,
  fn($x, $y) { ends-with($x, 'a') }
)
Result:
true()

(True because there is a run of 4 consecutive items ending in "a".)

2.2.4 fn:deep-equal

Changes in 4.0 (next | previous)

  1. When comments and processing instructions are ignored, any text nodes either side of the comment or processing instruction are now merged prior to comparison.  [Issue 930 PR 933 16 January 2024]

  2. The $options parameter has been added, absorbing the $collation parameter.  [Issues 934 1167 PR 1191 21 May 2024]

  3. A callback function can be supplied for comparing individual items.  [Issues 99 1142 PRs 1120 1150 9 April 2024]

  4. Atomic items of types xs:hexBinary and xs:base64Binary are now mutually comparable. In rare cases, where an application uses both types and assumes they are distinct, this can represent a backwards incompatibility.  [Issue 2139  14 August 2025]

Summary

This function assesses whether two sequences are deep-equal to each other. To be deep-equal, they must contain items that are pairwise deep-equal; and for two items to be deep-equal, they must either be atomic items that compare equal, or nodes of the same kind, with the same name, whose children are deep-equal, or maps with matching entries, or arrays with matching members.

Signature
fn:deep-equal(
$input1as item()*,
$input2as item()*,
$optionsas (xs:string | map(*))?:= {}
) as xs:boolean
Properties

The two-argument form of this function is deterministic, context-dependent, and focus-independent. It depends on collations, and implicit timezone.

The three-argument form of this function is deterministic, context-dependent, and focus-independent. It depends on collations, and static base URI, and implicit timezone.

Rules

The $options argument, if present, defines additional parameters controlling how the comparison is done. If it is supplied as a map, then the option parameter conventions apply.

For backwards compatibility reasons, the $options argument can also be set to a string containing a collation name. Supplying a string $S for this argument is equivalent to supplying the map { 'collation': $S }. Omitting the argument, or supplying the empty sequence, is equivalent to supplying an empty map.

If the two sequences ($input1 and $input2) are both empty, the function returns true.

If the two sequences are of different lengths, the function returns false.

If the two sequences are of the same length, the comparison is controlled by the ordered option:

  • By default, the option is true: The function returns true if and only if every item in the sequence $input1 is deep-equal to the item at the same position in the sequence $input2.

  • If the option is set to false, the function returns false if and only if every item in the sequence $input1 is deep-equal to an item at some position in the sequence $input2, and vice versa.

The rules for deciding whether two items are deep-equal appear below.

The entries that may appear in the $options map are as follows. The detailed rules for the interpretation of each option appear later.

record(
base-uri?as xs:boolean,
collation?as xs:string,
comments?as xs:boolean,
debug?as xs:boolean,
id-property?as xs:boolean,
idrefs-property?as xs:boolean,
in-scope-namespaces?as xs:boolean,
items-equal?as fn(item(), item()) as xs:boolean?,
map-order?as xs:boolean,
namespace-prefixes?as xs:boolean,
nilled-property?as xs:boolean,
normalization-form?as xs:string?,
ordered?as xs:boolean,
processing-instructions?as xs:boolean,
timezones?as xs:boolean,
type-annotations?as xs:boolean,
type-variety?as xs:boolean,
typed-values?as xs:boolean,
unordered-elements?as xs:QName*,
whitespace?as enum("preserve", "strip", "normalize")
)
KeyMeaning

base-uri?

Determines whether the base-uri of a node is significant.
  • Type: xs:boolean

  • Default: false

collation?

Identifies a collation which is used at all levels of recursion when strings are compared (but not when names are compared), according to the rules in 5.3.7 Choosing a collation. If the argument is not supplied, or if it is empty, then the default collation from the dynamic context of the caller is used.
  • Type: xs:string

  • Default: fn:default-collation()

comments?

Determines whether comments are significant.
  • Type: xs:boolean

  • Default: false

debug?

Requests diagnostics in the case where the function returns false. When this option is set and the two inputs are found to be not equal, the implementation should output messages (in an implementation-dependent format and to an implementation-dependent destination) indicating the nature of the differences that were found.
  • Type: xs:boolean

  • Default: false

id-property?

Determines whether the id property of elements and attributes is significant.
  • Type: xs:boolean

  • Default: false

idrefs-property?

Determines whether the idrefs property of elements and attributes is significant.
  • Type: xs:boolean

  • Default: false

in-scope-namespaces?

Determines whether the in-scope namespaces of elements are significant.
  • Type: xs:boolean

  • Default: false

items-equal?

A user-supplied function to test whether two items are considered equal. The function can return true or false to indicate that two items are or are not equal, overriding the normal rules that would apply to those items; or it can return an empty sequence, to indicate that the normal rules should be followed. Note that returning () is not equivalent to returning false.
  • Type: fn(item(), item()) as xs:boolean?

  • Default: fn:void#0

map-order?

Determines whether the order of entries in maps is significant.
  • Type: xs:boolean

  • Default: false

namespace-prefixes?

Determines whether namespace prefixes in xs:QName values (particularly the names of elements and attributes) are significant.
  • Type: xs:boolean

  • Default: false

nilled-property?

Determines whether the nilled property of elements and attributes is significant.
  • Type: xs:boolean

  • Default: false

normalization-form?

If present, indicates that text and attributes are converted to the specified Unicode normalization form prior to comparison. The value is as for the corresponding argument of fn:normalize-unicode.
  • Type: xs:string?

  • Default: ()

ordered?

Controls whether the top-level order of the items of the input sequences is considered.
  • Type: xs:boolean

  • Default: true

processing-instructions?

Determines whether processing instructions are significant.
  • Type: xs:boolean

  • Default: false

timezones?

Determines whether timezones in date/time values are significant.
  • Type: xs:boolean

  • Default: false

type-annotations?

Determines whether type annotations are significant.
  • Type: xs:boolean

  • Default: false

type-variety?

Determines whether the variety of the type annotation of an element (whether it has complex content or simple content) is significant.
  • Type: xs:boolean

  • Default: true

typed-values?

Determines whether nodes are compared using their typed values rather than their string values.
  • Type: xs:boolean

  • Default: true

unordered-elements?

A list of QNames of elements considered to be unordered: that is, their child elements may appear in any order.
  • Type: xs:QName*

  • Default: ()

whitespace?

Determines the extent to which whitespace is treated as significant. The value preserve retains all whitespace. The value strip ignores text nodes consisting entirely of whitespace. The value normalize ignores whitespace text nodes in the same way as the strip option, and additionally compares text and attribute nodes after normalizing whitespace in accordance with the rules of the fn:normalize-space function. The detailed rules, given below, also take into account type annotations and xml:space attributes.
  • Type: enum("preserve", "strip", "normalize")

  • Default: preserve

Note:

As a general rule for boolean options (but not invariably), the value true indicates that the comparison is more strict.

In the following rules, where a recursive call on fn:deep-equal is made, this is assumed to use the same values of $options as the original call.

The rules reference a function equal-strings which compares two xs:string or xs:anyURI values as follows:

  1. If the whitespace option is set to normalize, then each string is processed by calling the fn:normalize-space function.

  2. If the normalization-form option is present, each string is then normalized by calling the fn:normalize-unicode function, supplying the specified normalization form.

  3. The two strings are then compared for equality under the requested collation.

More formally, the equal-strings function is equivalent to the following implementation in XQuery:

declare function equal-strings(
  $string1  as xs:string,
  $string2  as xs:string, 
  $options  as map(*)
) as xs:boolean {
  let $n1 := if ($options?normalization-form)
             then normalize-unicode(?, $options?normalization-form) 
             else identity#1
  let $n2 := if ($options?whitespace = "normalize")
             then normalize-space#1 
             else identity#1               
  return compare($n1($n2($string1)), $n1($n2($string2)), $options?collation) eq 0    
}

The rules for deciding whether two items $i1 and $i2 are deep-equal are as follows.

The two items are first compared using the function supplied in the items-equal option. If this returns true then the items are deep-equal. If it returns false then the items are not deep-equal. If it returns an empty sequence (which is always the case if the option is not explicitly specified) then the two items are deep-equal if one or more of the following conditions are true:

  1. All of the following conditions are true:

    1. $i1 is an atomic item.

    2. $i2 is an atomic item.

    3. Either the type-annotations option is false, or both atomic items have the same type annotation.

    4. One of the following conditions is true:

      1. If both $i1 and $i2 are instances of xs:string, xs:untypedAtomic, or xs:anyURI, equal-strings($i1, $i2, $collation, $options) returns true.

      2. Otherwise, fn:compare($i1, $i2) returns zero.

      If $i1 and $i2 are not comparable, that is, if the expression compare($i1, $i2) raises an error, then the function returns false; it does not report an error.

    5. One of the following conditions is true:

      1. Option namespace-prefixes is false.

      2. Neither $i1 nor $i2 is of type xs:QName or xs:NOTATION.

      3. $i1 and $i2 are qualified names with the same namespace prefix.

    6. One of the following conditions is true:

      1. Option timezones is false.

      2. Neither $i1 nor $i2 is of type xs:date, xs:time, xs:dateTime, xs:gYear, xs:gYearMonth, xs:gMonth, xs:gMonthDay, or xs:gDay.

      3. Neither $i1 nor $i2 has a timezone component.

      4. Both $i1 and $i2 have a timezone component and the timezone components are equal.

  2. All of the following conditions are true:

    1. $i1 is a map.

    2. $i2 is a map.

    3. Both maps have the same number of entries.

    4. For every entry in the first map, there is an entry in the second map that:

      1. has the same key (note that the collation is not used when comparing keys), and

      2. has the same associated value (compared using the fn:deep-equal function, recursively).

    5. Either map-order is false, or the entries in both maps appear in the same order, that is, the Nth key in the first map is the same key as the Nth key in the second map, for all N.

  3. All the following conditions are true:

    1. $i1 is an array.

    2. $i2 is an array.

    3. Both arrays have the same number of members (array:size($i1) eq array:size($i2)).

    4. Members in the same position of both arrays are deep-equal to each other: that is, every $p in 1 to array:size($i1) satisfies deep-equal($i1($p), $i2($p), $collation, $options).

  4. All the following conditions are true:

    1. $i1 is a function item and is not a map or array.

    2. $i2 is a function item and is not a map or array.

    3. $i1 and $i2 have the same function identity. The concept of function identity is explained in [XQuery and XPath Data Model (XDM) 4.0] section 8.1 Function Items.

  5. All the following conditions are true:

    1. $i1 is a node (specifically, an XNode).

    2. $i2 is a node (specifically, an XNode).

    3. Both nodes have the same node kind.

    4. Either the base-uri option is false, or both nodes have the same value for their base URI property, or both nodes have an absent base URI.

    5. Let significant-children($parent) be the sequence of nodes obtained by applying the following steps to the children of $parent, in turn:

      1. Comment nodes are discarded if the option comments is false.

      2. Processing instruction nodes are discarded if the option processing-instructions is false.

      3. Adjacent text nodes are merged.

      4. Whitespace-only text nodes are discarded if both the following conditions are true:

        1. The option whitespace is set to strip or normalize; and

        2. The text node is not within the scope of an element that has the attribute xml:space="preserve".

        Note:

        Whitespace text nodes will already have been discarded if $parent is a schema-validated element node whose type annotation is a complex type with an element-only or empty content model.

    6. One of the following conditions is true.

      1. Both nodes are document nodes, and the sequence significant-children($i1) is deep-equal to the sequence significant-children($i2).

      2. Both nodes are element nodes, and all the following conditions are true:

        1. The two nodes have the same name, that is (node-name($i1) eq node-name($i2)).

        2. Either the option namespace-prefixes is false, or both element names have the same prefix.

        3. Either the option in-scope-namespaces is false, or both element nodes have the same in-scope namespace bindings.

        4. Either the option type-annotations is false, or both element nodes have the same type annotation.

        5. Either the option id-property is false, or both element nodes have the same value for their is-id property.

        6. Either the option idrefs-property is false, or both element nodes have the same value for their is-idrefs property.

        7. Either the option nilled-property is false, or both element nodes have the same value for their nilled property.

        8. One of the following conditions is true:

          1. The option type-variety is false.

          2. Both nodes are annotated as having simple content. For this purpose simple content means either a simple type or a complex type with simple content.

          3. Both nodes are annotated as having complex content. For this purpose complex content means a complex type whose variety is mixed, element-only, or empty.

          Note:

          It is a consequence of this rule that, by default, validating a document D against a schema will usually (but not necessarily) result in a document that is not deep-equal to D. The exception is when the schema allows all elements to have mixed content.

        9. The two nodes have the same number of attributes, and for every attribute $a1 in $i1/@* there exists an attribute $a2 in $i2/@* such that node-name($a1) eq node-name($a2) and $a1 and $a2 are deep-equal.

          Note:

          Attributes, like other items, may be compared using the supplied items-equal function. However, this function will not be called to compare two attribute nodes unless they have the same name.

        10. One of the following conditions holds:

          1. Both element nodes are annotated as having simple content (as defined above), the typed-values option is true, and the typed value of $i1 is deep-equal to the typed value of $i2.

            Note:

            The typed value of an element node is used only when the element has simple content, which means that no error can occur as a result of atomizing a node with no typed value.

          2. Both element nodes are annotated as having simple content (as defined above), the typed-values option is false, and the equal-strings function returns true when applied to the string value of $i1 and the string value of $i2.

          3. Both element nodes have a type annotation that is a complex type with element-only, mixed, or empty content, the (common) element name is not present in the unordered-elements option, and the sequence significant-children($i1) is deep-equal to the sequence significant-children($i2).

          4. Both element nodes have a type annotation that is a complex type with element-only, mixed, or empty content, the (common) element name is present in the unordered-elements option, and the sequence significant-children($i1) is deep-equal to some permutation of the sequence significant-children($i2).

            Note:

            Elements annotated as xs:untyped fall into this category.

            Including an element name in the unordered-elements list is unlikely to be useful except when the relevant elements have element-only content, but this is not a requirement: the rules apply equally to elements with mixed content, or even (trivially) to elements with empty content.

      3. Both nodes are attribute nodes, and all the following conditions are true:

        1. The two attribute nodes have the same name, that is (node-name($i1) eq node-name($i2)).

        2. Either the option namespace-prefixes is false, or both attribute names have the same prefix.

        3. Either the option type-annotations is false, or both attribute nodes have the same type annotation.

        4. Either the option id-property is false, or both attribute nodes have the same value for their is-id property.

        5. Either the option idrefs-property is false, or both attribute nodes have the same value for their is-idrefs property.

        6. Let T be true if the option typed-value is true and both attributes $i1 and $i2 have a type annotation other than xs:untypedAtomic.

          Then either T is true and the typed value of $i1 is deep-equal to the typed value of $i2, or T is false and the equal-strings function returns true when applied to the string value of $i1 and the string value of $i2.

      4. Both nodes are processing instruction nodes, and all the following conditions are true:

        1. The two nodes have the same name, that is (node-name($i1) eq node-name($i2)).

        2. The equal-strings function returns true when applied to the string value of $i1 and the string value of $i2.

      5. Both nodes are namespace nodes, and all the following conditions are true:

        1. The two nodes either have the same name or are both nameless, that is fn:deep-equal(node-name($i1), node-name($i2)).

        2. The string value of $i1 is equal to the string value of $i2 when compared using the Unicode codepoint collation.

        Note:

        Namespace nodes are not considered directly unless they appear in the top-level sequences passed explicitly to the fn:deep-equal function.

      6. Both nodes are comment nodes, and the equal-strings function returns true when applied to their string values.

      7. Both nodes are text nodes, and the equal-strings function returns true when applied to their string values.

  6. All the following conditions are true:

    1. $i1 is a JNode.

    2. $i2 is a JNode.

    3. The ·content· property of $i1 is deep-equal to the ·content· property of $i2.

      Note:

      The other properties of the two JNodes, such as ·parent· and ·selector·, are ignored. As with XNodes, deep equality considers only the subtree rooted at the node, and not its position within a containing tree.

In all other cases the result is false.

Error Conditions

A type error is raised [err:XPTY0004]XP if the value of $options includes an entry whose key is defined in this specification, and whose value is not of the permitted type for that key.

A dynamic error is raised [err:FOJS0005] if the value of $options includes an entry whose key is defined in this specification, and whose value is not a permitted value for that key.

Notes

By default, whitespace in text nodes and attributes is considered significant. There are various ways whitespace differences can be ignored:

  • If nodes have been schema-validated, setting the typed-values option to true causes the typed values rather than the string values to be compared. This will typically cause whitespace to be ignored except where the type of the value is xs:string.

  • Setting the whitespace option to normalize causes all text and attribute nodes to have leading and trailing whitespace removed, and intermediate whitespace reduced to a single character.

By default, two nodes are not required to have the same type annotation, and they are not required to have the same in-scope namespaces. They may also differ in their parent, their base URI, and the values returned by the is-id and is-idrefs accessors (see [XQuery and XPath Data Model (XDM) 4.0] section 7.6.5 is-id Accessor and [XQuery and XPath Data Model (XDM) 4.0] section 7.6.6 is-idrefs Accessor). The order of children is significant, but the order of attributes is insignificant.

By default, the contents of comments and processing instructions are significant only if these nodes appear directly as items in the two sequences being compared. The content of a comment or processing instruction that appears as a descendant of an item in one of the sequences being compared does not affect the result. In previous versions of this specification, the presence of a comment or processing instruction, if it caused text to be split across two text nodes, might affect the result; this has been changed in 4.0 so that adjacent text nodes are merged after comments and processing instructions have been stripped.

Comparing items of different kind (for example, comparing an atomic item to a node, or a map to an array, or an integer to an xs:date) returns false, it does not return an error. So the result of fn:deep-equal(1, current-dateTime()) is false.

The items-equal callback function may be used to override the default rules for comparing individual items. For example, it might return true unconditionally when comparing two @timestamp attributes, if there is no expectation that the two trees will have identical timestamps. Given two nodes $n1 and $n2, it might compare them using the is operator, so that instead of comparing the descendants of the two nodes, the function simply checks whether they are the same node. Given two function items $f1 and $f2 it might return true unconditionally, knowing that there is no effective way to test if the functions are equivalent. Given two numeric values, it might return true if they are equal to six decimal places.

It is good practice for the items-equal callback function to be reflexive, symmetric, and transitive; if it is not, then the fn:deep-equal function itself will lack these qualities. Reflexive means that every item (including NaN) should be equal to itself; symmetric means that items-equal(A, B) should return the same result as items-equal(B, A), and transitive means that items-equal(A, B) and items-equal(B, C) should imply items-equal(A, C).

Setting the ordered option to false or supplying the unordered-elements option may result in poor performance when comparing long sequences, especially if the items-equal callback function is supplied.

Examples
Variables
let $at := <attendees>
  <name last="Parker" first="Peter"/>
  <name last="Barker" first="Bob"/>
  <name last="Parker" first="Peter"/>
</attendees>
Expression:

deep-equal($at, $at/*)

Result:

false()

Expression:

deep-equal($at/name[1], $at/name[2])

Result:

false()

Expression:

deep-equal($at/name[1], $at/name[3])

Result:

true()

Expression:

deep-equal($at/name[1], 'Peter Parker')

Result:

false()

Expression:
deep-equal(
  $at//name[@first="Bob"], 
  $at//name[@last="Barker"],
  options := { 'items-equal': op('is') } 
)
Result:
true()

(Tests whether the two input sequences contain exactly the same nodes.)

Expression:

deep-equal([ 1, 2, 3], [ 1, 2, 3 ])

Result:

true()

Expression:

deep-equal((1, 2, 3), [ 1, 2, 3 ])

Result:

false()

Expression:
deep-equal(
  { 1: 'a', 2: 'b' },
  { 2: 'b', 1: 'a' }
)
Result:
true()
Expression:
deep-equal(
  (1, 2, 3, 4),
  (1, 4, 3, 2),
  options := { 'ordered': false() }
)
Result:
true()
Expression:
deep-equal(
  (1, 1, 2, 3),
  (1, 2, 3, 3),
  options := { 'ordered': false() }
)
Result:
false()
Expression:
deep-equal(
  parse-xml("<a xmlns='AA'/>"),
  parse-xml("<p:a xmlns:p='AA'/>")
)
Result:
true()

(By default, namespace prefixes are ignored).

Expression:
deep-equal(
  parse-xml("<a xmlns='AA'/>"),
  parse-xml("<p:a xmlns:p='AA'/>"),
  options := { 'namespace-prefixes': true() }
)
Result:
false()

(False because the namespace prefixes differ).

Expression:
deep-equal(
  parse-xml("<a xmlns='AA'/>"),
  parse-xml("<p:a xmlns:p='AA'/>"),
  options := { 'in-scope-namespaces': true() }
)
Result:
false()

(False because the in-scope namespace bindings differ).

Expression:
deep-equal(
  parse-xml("<a><b/><c/></a>"),
  parse-xml("<a><c/><b/></a>")
)
Result:
false()

(By default, order of elements is significant).

Expression:
deep-equal(
  parse-xml("<a><b/><c/></a>"),
  parse-xml("<a><c/><b/></a>"),
  options := { 'unordered-elements': #a }
)
Result:
true()

(The unordered-elements option means that the ordering of the children of a is ignored.)

Expression:
deep-equal(
  parse-xml("<para style='bold'><span>x</span></para>"),
  parse-xml("<para style=' bold'> <span>x</span></para>")
)
Result:
false()

(By default, both the leading whitespace in the style attribute and the whitespace text node preceding the span element are significant.)

Expression:
deep-equal(
  parse-xml("<para style='bold'><span>x</span></para>"),
  parse-xml("<para style=' bold'> <span>x</span></para>"),
  options := { 'whitespace': 'normalize' }
)
Result:
true()

(The whitespace option causes both the leading space in the attribute value and the whitespace preceding the span element to be ignored.)

Expression:
deep-equal(
  (1, 2, 3), 
  (1.0007, 1.9998, 3.0005),
  options := { 'items-equal': fn($x, $y) {
    if (($x, $y) instance of xs:numeric+) {
      abs($x - $y) lt 0.001
    }
  } }
)
Result:
true()

(For numeric values, the callback function tests whether they are approximately equal. For any other items, it returns an empty sequence, so the normal comparison rules apply.)

Expression:
deep-equal(
  (1, 2, 3, 4, 5), 
  (1, 2, 3, 8, 5),
  options := { 'items-equal': fn($x, $y) {
    trace((), `comparing { $x } and { $y }`)
  } }
)
Result:
false()

(The callback function traces which items are being compared, without changing the result of the comparison.)

2.2.5 fn:distinct-values

Changes in 4.0 (next | previous)

  1. Changed in 4.0 to use transitive equality comparisons for numeric values.

  2. The order of results is now prescribed; it was previously implementation-dependent.  [Issue 628 PR 987]

  3. Atomic items of types xs:hexBinary and xs:base64Binary are now mutually comparable. In rare cases, where an application uses both types and assumes they are distinct, this can represent a backwards incompatibility.  [Issue 2139  14 August 2025]

Summary

Returns the values that appear in a sequence, with duplicates eliminated.

Signature
fn:distinct-values(
$valuesas xs:anyAtomicType*,
$collationas xs:string?:= fn:default-collation()
) as xs:anyAtomicType*
Properties

The one-argument form of this function is deterministic, context-dependent, and focus-independent. It depends on collations, and implicit timezone.

The two-argument form of this function is deterministic, context-dependent, and focus-independent. It depends on collations, and static base URI, and implicit timezone.

Rules

The function returns the sequence that results from removing from $values all but one of a set of values that are contextually equal to one another, when compared using the collation selected according to the rules in 5.3.7 Choosing a collation and the implicit timezone from the dynamic context.

The ordering of the result is as follows:

  • For any set of values that compare equal, the one that is returned is the one that appears first in $values.

  • The items that are returned appear in the order of their first appearance within $values.

Formal Equivalent

The effect of the function is equivalent to the result of the following XPath expression.

filter($values, 
  fn($item, $pos) {
    empty(
      filter(
        subsequence($values, 1, $pos - 1),
        deep-equal(?, $item, $collation)
      )
    )
  }
)
Notes

If $values is the empty sequence, the function returns the empty sequence.

Values of type xs:untypedAtomic are compared as if they were of type xs:string.

Values that cannot be compared, because the eq operator is not defined for their types, are considered to be distinct.

For numeric values, the rules are the same as fn:atomic-equal: positive and negative zero are treated as equal, NaN is treated as equal to NaN, and values of different numeric types are converted to unlimited-precision decimals for comparison purposes.

If xs:dateTime, xs:date or xs:time values do not have a timezone, they are considered to have the implicit timezone provided by the dynamic context for the purpose of comparison. Note that xs:dateTime, xs:date or xs:time values can compare equal even if their timezones are different.

Examples
ExpressionResult
distinct-values((1, 2.0, 3, 2))

1, 2.0, 3

distinct-values((
  xs:untypedAtomic("cherry"),
  xs:untypedAtomic("plum"),
  xs:untypedAtomic("plum")
))
xs:untypedAtomic("cherry"), xs:untypedAtomic("plum")

2.2.6 fn:duplicate-values

Changes in 4.0 (next | previous)

  1. New in 4.0  [Issues 123 628 1869 PRs 614 987]

Summary

Returns the values that appear in a sequence more than once.

Signature
fn:duplicate-values(
$valuesas xs:anyAtomicType*,
$collationas xs:string?:= fn:default-collation()
) as xs:anyAtomicType*
Properties

The one-argument form of this function is deterministic, context-dependent, and focus-independent. It depends on collations, and implicit timezone.

The two-argument form of this function is deterministic, context-dependent, and focus-independent. It depends on collations, and static base URI, and implicit timezone.

Rules

The items of $values are compared against each other, according to the rules of fn:distinct-values and with $coll as the collation selected according to the rules in 5.3.7 Choosing a collation.

From each resulting set of values that are considered equal, one value will be returned if the set contains more than one value.

Specifically, the function returns those items in $values that are contextually equal to exactly one item appearing earlier in the sequence.

This means that the ordering of the result is as follows:

  • For any set of values that compare equal, the one that is returned is the one that appears second in $values.

  • The items that are returned appear in the order of their second appearance within $values.

Formal Equivalent

The effect of the function is equivalent to the result of the following XPath expression.

filter(
  $values, 
  fn($item, $pos) {
    count(
      filter(
        subsequence($values, 1, $pos - 1),
        deep-equal(?, $item, $collation)
      )
    ) eq 1
  }
)
Notes

The comparison rules are exactly the same as the fn:distinct-values function.

Examples
Expression:

duplicate-values((1, 2, 3, 1.0, 1e0))

Result:

1.0

Expression:

duplicate-values(1 to 100)

Result:

()

Expression:

duplicate-values(('1', <x>1</x>, '2', 2))

Result:

xs:untypedAtomic("1")

(The string "1" and the untyped value of the element node are considered equal, whereas the string "2" and the integer are considered unequal.)

Raise an error for duplicates in an ID sequence:

let $ids := duplicate-values(//@id)
where exists($ids)
return error((), 'Duplicate IDs found: ' || string-join($ids, ', '))

2.2.7 fn:ends-with-subsequence

Changes in 4.0 (next | previous)

  1. New in 4.0  [Issue 92 PR 222 1 November 2022]

Summary

Determines whether one sequence ends with another, using a supplied callback function to compare items.

Signature
fn:ends-with-subsequence(
$inputas item()*,
$subsequenceas item()*,
$compareas (fn(item(), item()) as xs:boolean?)?:= fn:deep-equal#2
) as xs:boolean
Properties

The two-argument form of this function is deterministic, context-dependent, and focus-independent. It depends on collations, and implicit timezone.

The three-argument form of this function is deterministic, context-independent, and focus-independent.

Rules

Informally, the function returns true if $input ends with $subsequence, when items are compared using the supplied (or default) $compare function.

Formal Equivalent

The effect of the function is equivalent to the result of the following XPath expression.

starts-with-subsequence(reverse($input), reverse($subsequence), $compare)
Notes

There is no requirement that the $compare function should have the traditional qualities of equality comparison. The result is well-defined, for example, even if $compare is not transitive or not symmetric.

A return value of () from the function is treated as false.

Examples
Expression:

ends-with-subsequence((), ())

Result:

true()

Expression:

ends-with-subsequence(1 to 10, 5 to 10)

Result:

true()

Expression:

ends-with-subsequence(1 to 10, ())

Result:

true()

Expression:

ends-with-subsequence(1 to 10, 1 to 10)

Result:

true()

Expression:

ends-with-subsequence(1 to 10, 10)

Result:

true()

Expression:
ends-with-subsequence(
  1 to 10,
  108 to 110,
  fn($x, $y) { $x mod 100 = $y mod 100 }
)
Result:
true()
Expression:
ends-with-subsequence(
  ("A", "B", "C"),
  ("b", "c"),
  fn($x, $y) {
    compare(
      $x,
      $y,
      "http://www.w3.org/2005/xpath-functions/collation/html-ascii-case-insensitive"
    ) eq 0
  }
)
Result:
true()
Expression:
let $p := parse-xml("<doc><chap><p/><p/></chap></doc>")//p[2]
return ends-with-subsequence(
  $p/ancestor::node()[last()],
  $p/root(),
  op("is")
)
Result:
true()
Expression:

ends-with-subsequence(10 to 20, 1 to 5, op("gt"))

Result:

true()

Expression:
ends-with-subsequence(
  ("Alpha", "Beta", "Gamma"),
  ("B", "G"),
  starts-with#2
)
Result:
true()
Expression:
ends-with-subsequence(
  ("Alpha", "Beta", "Gamma", "Delta"),
  1 to 2,
  fn($x, $y) { string-length($x) eq 5 }
)
Result:
true()

(True because the last two items in the input sequence have a string length of 5.)

2.2.8 fn:index-of

Changes in 4.0 (next | previous)

  1. In the interests of consistency, the index-of function now defines equality to mean contextually equal. This has the implication that NaN is now considered equal to NaN.  [Issue 2216 PR 2256 1 December 2025]

Summary

Returns a sequence of positive integers giving the positions within the sequence $input of items that are contextually equal to $target.

Signature
fn:index-of(
$inputas xs:anyAtomicType*,
$targetas xs:anyAtomicType,
$collationas xs:string?:= fn:default-collation()
) as xs:integer*
Properties

The two-argument form of this function is deterministic, context-dependent, and focus-independent. It depends on collations, and implicit timezone.

The three-argument form of this function is deterministic, context-dependent, and focus-independent. It depends on collations, and static base URI, and implicit timezone.

Rules

The function returns a sequence of positive integers giving the 1-based positions within the sequence $input of items that are contextually equal to $target.

The collation used by this function is determined according to the rules in 5.3.7 Choosing a collation. This collation is used when string comparison is required.

The result sequence is in ascending numeric order.

Notes

If $input is the empty sequence, or if no item in $input matches $target, then the function returns the empty sequence.

No error occurs if non-comparable values are encountered. So when comparing two atomic items, the effective boolean value of fn:index-of($a, $b) is true if $a and $b are equal, false if they are not equal or not comparable.

Examples
Expression:

index-of((10, 20, 30, 40), 35)

Result:

()

Expression:

index-of((10, 20, 30, 30, 20, 10), 20)

Result:

2, 5

Expression:
index-of(
  ("a", "sport", "and", "a", "pastime"),
  "a"
)
Result:
1, 4
Expression:
index-of(
  ("a", "b", "c"),
  "B",
  "http://www.w3.org/2005/xpath-functions/collation/html-ascii-case-insensitive"
)
Result:
2
Expression:

index-of(current-date(), 23)

Result:

()

Expression:

index-of([ 1, [ 5, 6 ], [ 6, 7 ] ], 6)

Result:

3, 4

(The array is atomized to a sequence of five integers).

If @a is an attribute of type xs:NMTOKENS whose string value is "red green blue", and whose typed value is therefore ("red", "green", "blue"), then fn:index-of(@a, "blue") returns 3. This is because the function calling mechanism atomizes the attribute node to produce a sequence of three xs:NMTOKEN values.

2.2.9 fn:starts-with-subsequence

Changes in 4.0 (next | previous)

  1. New in 4.0  [Issue 92 PR 222 1 November 2022]

Summary

Determines whether one sequence starts with another, using a supplied callback function to compare items.

Signature
fn:starts-with-subsequence(
$inputas item()*,
$subsequenceas item()*,
$compareas (fn(item(), item()) as xs:boolean?)?:= fn:deep-equal#2
) as xs:boolean
Properties

The two-argument form of this function is deterministic, context-dependent, and focus-independent. It depends on collations, and implicit timezone.

The three-argument form of this function is deterministic, context-independent, and focus-independent.

Rules

Informally, the function returns true if $input starts with $subsequence, when items are compared using the supplied (or default) $compare function.

Formal Equivalent

The effect of the function is equivalent to the result of the following XPath expression.

count($input) ge count($subsequence) and
every(for-each-pair($input, $subsequence, $compare))
Notes

There is no requirement that the $compare function should have the traditional qualities of equality comparison. The result is well-defined, for example, even if $compare is not transitive or not symmetric. A return value of () from the function is treated as false.

Examples
Expression:

starts-with-subsequence((), ())

Result:

true()

Expression:

starts-with-subsequence(1 to 10, 1 to 5)

Result:

true()

Expression:

starts-with-subsequence(1 to 10, ())

Result:

true()

Expression:

starts-with-subsequence(1 to 10, 1 to 10)

Result:

true()

Expression:

starts-with-subsequence(1 to 10, 1)

Result:

true()

Expression:
starts-with-subsequence(
  1 to 10,
  101 to 105,
  fn($x, $y) { $x mod 100 = $y mod 100 }
)
Result:
true()
Expression:
starts-with-subsequence(
  ("A", "B", "C"),
  ("a", "b"),
  fn($x, $y) {
    compare(
      $x,
      $y,
      "http://www.w3.org/2005/xpath-functions/collation/html-ascii-case-insensitive"
    ) eq 0
  }
)
Result:
true()
Expression:
let $p := parse-xml("<doc><chap><p/><p/></chap></doc>")//p[2]
return starts-with-subsequence(
  $p/ancestor::*[1],
  $p/parent::*,
  op("is")
)
Result:
true()
Expression:

starts-with-subsequence(10 to 20, 1 to 5, op("gt"))

Result:

true()

Expression:
starts-with-subsequence(
  ("Alpha", "Beta", "Gamma"),
  ("A", "B"),
  starts-with#2
)
Result:
true()
Expression:
starts-with-subsequence(
  ("Alpha", "Beta", "Gamma", "Delta"),
  1 to 3,
  fn($x, $y) { ends-with($x, 'a' ) }
)
Result:
true()

(True because the first three items in the input sequence end with "a".)

2.4 Aggregate functions

Aggregate functions take a sequence as argument and return a single value computed from values in the sequence. Except for fn:count, the sequence must consist of values of a single type or one if its subtypes, or they must be numeric. xs:untypedAtomic values are permitted in the input sequence and handled by special conversion rules. The type of the items in the sequence must also support certain operations.

FunctionMeaning
fn:countReturns the number of items in a sequence.
fn:all-equalReturns true if all items in a supplied sequence (after atomization) are contextually equal.
fn:all-differentReturns true if no two items in a supplied sequence are contextually equal.
fn:avgReturns the average of the values in the input sequence $values, that is, the sum of the values divided by the number of values.
fn:maxReturns a value that is greater than or equal to every other value appearing in the input sequence.
fn:minReturns a value that is less than or equal to every other value appearing in the input sequence.
fn:sumReturns a value obtained by adding together the values in $values.

2.4.2 fn:all-equal

Changes in 4.0 (next | previous)

  1. New in 4.0. Originally proposed under the name fn:uniform  [  20 September 2022]

Summary

Returns true if all items in a supplied sequence (after atomization) are contextually equal.

Signature
fn:all-equal(
$valuesas xs:anyAtomicType*,
$collationas xs:string?:= fn:default-collation()
) as xs:boolean
Properties

This function is deterministic, context-dependent, and focus-independent. It depends on collations.

Rules

Omitting the second argument, $collation, is equivalent to supplying fn:default-collation(). For more information on collations see 5.3.7 Choosing a collation.

The collation used by this function is determined according to the rules in 5.3.7 Choosing a collation.

The result of the function fn:all-equal($values, $collation) is true if and only if the result of fn:count(fn:distinct-values($values, $collation)) le 1 is true (that is, if the sequence is empty, or if all the items in the sequence are equal under the rules of the fn:distinct-values function).

Examples
Expression:

all-equal((1, 2, 3))

Result:

false()

Expression:

all-equal((1, 1.0, 1.0e0))

Result:

true()

Expression:

all-equal("one")

Result:

true()

Expression:

all-equal(())

Result:

true()

Expression:

all-equal((xs:float('NaN'), xs:double('NaN')))

Result:

true()

Expression:
all-equal(
  ("ABC", "abc"),
  "http://www.w3.org/2005/xpath-functions/collation/html-ascii-case-insensitive"
)
Result:
true()

The expression fn:all-equal(//p/@class) returns true if all p elements have the same value for @class.

The expression fn:all-equal(* ! fn:node-name()) returns true if all element children of the context node have the same name.

2.4.3 fn:all-different

Changes in 4.0 (next | previous)

  1. New in 4.0. Originally proposed under the name fn:unique  [  20 September 2022]

Summary

Returns true if no two items in a supplied sequence are contextually equal.

Signature
fn:all-different(
$valuesas xs:anyAtomicType*,
$collationas xs:string?:= fn:default-collation()
) as xs:boolean
Properties

This function is deterministic, context-dependent, and focus-independent. It depends on collations.

Rules

Omitting the second argument, $collation, is equivalent to supplying fn:default-collation(). For more information on collations see 5.3.7 Choosing a collation.

The collation used by this function is determined according to the rules in 5.3.7 Choosing a collation.

The result of the function fn:all-different($values, $collation) is true if and only if the result of fn:count(fn:distinct-values($values, $collation)) eq fn:count($values) is true (that is, if the sequence is empty, or if all the items in the sequence are contextually unequal under the rules used by the fn:distinct-values function).

Examples
Expression:

all-different((1, 2, 3))

Result:

true()

Expression:

all-different((1, 1.0, 1.0e0))

Result:

false()

Expression:

all-different("one")

Result:

true()

Expression:

all-different(())

Result:

true()

Expression:
all-different(
  ("ABC", "abc"),
  "http://www.w3.org/2005/xpath-functions/collation/html-ascii-case-insensitive"
)
Result:
false()

The expression fn:all-different(//employee/@ssn) is true if no two employees have the same value for their @ssn attribute.

The expression fn:all-different(* ! fn:node-name()) returns true if all element children of the context node have distinct names.

2.4.5 fn:max

Changes in 4.0 (next | previous)

  1. The way that fn:min and fn:max compare numeric values of different types has changed. The most noticeable effect is that when these functions are applied to a sequence of xs:integer or xs:decimal values, the result is an xs:integer or xs:decimal, rather than the result of converting this to an xs:float or xs:double.  [Issue 866 PR 881 6 December 2023]

Summary

Returns a value that is greater than or equal to every other value appearing in the input sequence.

Signature
fn:max(
$valuesas xs:anyAtomicType*,
$collationas xs:string?:= fn:default-collation()
) as xs:anyAtomicType?
Properties

The one-argument form of this function is deterministic, context-dependent, and focus-independent. It depends on collations, and implicit timezone.

The two-argument form of this function is deterministic, context-dependent, and focus-independent. It depends on collations, and static base URI, and implicit timezone.

Rules

Any item in $values that is an instance of xs:untypedAtomic is first cast to xs:double. The resulting sequence is referred to as the converted sequence.

All pairs of values in the converted sequence must be mutually comparable. Two values A and B are mutually comparable if fn:compare(A, B) raises no error.

If the converted sequence is empty, the function returns the empty sequence.

If the converted sequence contains the value NaN, the value NaN is returned (as an xs:float or xs:double as appropriate).

Two items A and B from the converted sequence are compared by calling fn:compare(A, B, $collation), where $collation is determined by the rules in 5.3.7 Choosing a collation:

The result of the function is a value from the converted sequence that is greater than or equal to every other value under the above rules. If there is more than one such value, then it is implementation-dependent which of them is returned.

Error Conditions

A type error is raised [err:FORG0006] if the input sequence contains items of incompatible types, as described above.

Notes

If there are two or items that are “equal highest”, the specific item whose value is returned is implementation-dependent. This can arise for example if two different strings compare equal under the selected collation, or if two different xs:dateTime values compare equal despite being in different timezones.

If the converted sequence contains exactly one value then that value is returned.

The default type when the fn:max function is applied to xs:untypedAtomic values is xs:double. This differs from the default type for operators such as lt, and for sorting in XQuery and XSLT, which is xs:string.

In version 4.0, if $values is a sequence of xs:decimal values (including the case where it is a sequence of xs:integer values), then the result will be one of these xs:decimal or xs:integer values. In earlier versions it would be the result of converting this xs:decimal to xs:float or xs:double.

Examples
ExpressionResult
max((3, 2, 1))

3

max([ 3, 2, 1 ])

3

(Arrays are atomized).

max((
  xs:integer(5),
  xs:float(5),
  xs:double(0)
))

5

(The result may be either the xs:integer or the xs:float, since they are equal.)

max((
  xs:float(0.0E0),
  xs:float(-0.0E0)
))

xs:float(0.0e0)

(The result may be either positive or negative zero, since they are equal.)

max((
  current-date(),
  xs:date("2100-01-01")
))

xs:date("2100-01-01")

(Assuming that the current date is during the 21st century.)

max(("a", "b", "c"))

"c"

(Assuming a typical default collation.)

max((3, 4, "Zero")) raises a type error [err:FORG0006].

2.4.6 fn:min

Changes in 4.0 (next | previous)

  1. The way that fn:min and fn:max compare numeric values of different types has changed. The most noticeable effect is that when these functions are applied to a sequence of xs:integer or xs:decimal values, the result is an xs:integer or xs:decimal, rather than the result of converting this to an xs:float or xs:double.  [Issue 866 PR 881 6 December 2023]

Summary

Returns a value that is less than or equal to every other value appearing in the input sequence.

Signature
fn:min(
$valuesas xs:anyAtomicType*,
$collationas xs:string?:= fn:default-collation()
) as xs:anyAtomicType?
Properties

The one-argument form of this function is deterministic, context-dependent, and focus-independent. It depends on collations, and implicit timezone.

The two-argument form of this function is deterministic, context-dependent, and focus-independent. It depends on collations, and static base URI, and implicit timezone.

Rules

Any item in $values that is an instance of xs:untypedAtomic is first cast to xs:double. The resulting sequence is referred to as the converted sequence.

All pairs of values in the converted sequence must be mutually comparable. Two values A and B are mutually comparable if fn:compare(A, B) raises no error.

If the converted sequence is empty, the function returns the empty sequence.

If the converted sequence contains the value NaN, the value NaN is returned (as an xs:float or xs:double as appropriate).

Two items A and B from the converted sequence are compared by calling fn:compare(A, B, $collation), where $collation is determined by the rules in 5.3.7 Choosing a collation:

The result of the function is a value from the converted sequence that is less than or equal to every other value under the above rules. If there is more than one such value, then it is implementation-dependent which of them is returned.

Error Conditions

A type error is raised [err:FORG0006] if the input sequence contains items of incompatible types, as described above.

Notes

If there are two or items that are “equal lowest”, the specific item whose value is returned is implementation-dependent. This can arise for example if two different strings compare equal under the selected collation, or if two different xs:dateTime values compare equal despite being in different timezones.

If the converted sequence contains exactly one value then that value is returned.

The default type when the fn:min function is applied to xs:untypedAtomic values is xs:double. This differs from the default type for operators such as lt, and for sorting in XQuery and XSLT, which is xs:string.

In version 4.0, if $values is a sequence of xs:decimal values (including the case where it is a sequence of xs:integer values), then the result will be one of these xs:decimal or xs:integer values. In earlier versions it would be the result of converting this xs:decimal to xs:float or xs:double.

Examples
ExpressionResult
min((3, 4, 5))

3

min([ 3, 4, 5 ])

3

(Arrays are atomized).

min((
  xs:integer(5),
  xs:float(5),
  xs:double(10)
))

5

(The result may be either the xs:integer or the xs:float, since they are equal.)

min((
  xs:float(0.0E0),
  xs:float(-0.0E0)
))

xs:float(0.0e0)

(The result may be either positive or negative zero, since they are equal.)

min((
  current-date(),
  xs:date("1900-01-01")
))

xs:date("1900-01-01")

(Assuming that the current date is set to a reasonable value.)

min(("a", "b", "c"))

"a"

(Assuming a typical default collation.)

min((3, 4, "Zero")) raises a type error [err:FORG0006].

2.4.7 fn:sum

Changes in 4.0 (next | previous)

  1. In 3.1, given a mixed input sequence such as (1, 3, 4.2e0), the specification was unclear whether it was permitted to add the first two integer items using integer arithmetic, rather than converting all items to doubles before performing any arithmetic. The 4.0 specification is clear that this is permitted; but since the items can be reordered before being added, this is not required.  [Issue 1682 PR 1734 27 January 2025]

Summary

Returns a value obtained by adding together the values in $values.

Signature
fn:sum(
$valuesas xs:anyAtomicType*,
$zeroas xs:anyAtomicType?:= 0
) as xs:anyAtomicType?
Properties

This function is deterministic, context-independent, and focus-independent.

Rules

Any value of type xs:untypedAtomic in $values is cast to xs:double. The items in the resulting sequence may be reordered in an arbitrary order. The resulting sequence is referred to below as the converted sequence.

If the converted sequence is empty, then the function returns the value of the argument $zero, which defaults to the xs:integer value 0.

In other cases the items in the converted sequence are added pairwise according the rules of the + operator.

Specifically, the result of the function is the value of the expression:

if (empty($c)) then $zero
else if (count($c) eq 1) then $c
else head($c) + sum(tail($c))

where $c is the converted sequence.

This has the effect that a type error will occur unless one of the following conditions is satisfied:

  1. Every item in $values is an instance of xs:yearMonthDuration.

  2. Every item in $values is an instance of xs:dayTimeDuration.

  3. Every item in $values is an instance of xs:numeric.

Error Conditions

A type error is raised [err:FORG0006] if the input sequence contains items of incompatible types, as described above.

Notes

The second argument allows an appropriate value to be defined to represent the sum of an empty sequence. For example, when summing a sequence of durations it would be appropriate to return a zero-length duration of the appropriate type. This argument is necessary because a system that does dynamic typing cannot distinguish “an empty sequence of integers", for example, from “an empty sequence of durations”.

The explicit or implicit value of the $zero argument is used only when the input sequence is empty, not when a non-empty sequence sums to zero. For example, sum((-1, +1), xs:double('NaN')) returns the xs:integer value 0, not NaN.

The sum of a sequence of integers will be an integer, while the sum of a numeric sequence that includes at least one xs:double will be an xs:double.

If the converted sequence contains exactly one value then that value is returned.

If the converted sequence contains the value NaN, NaN is returned.

In edge cases the fact that the input sequence may be reordered makes the result slightly unpredictable. For example, if the input contains two xs:decimal values and an xs:float, then the decimal values might be added using decimal arithmetic, or they might both be converted to xs:float (potentially losing precision) before any arithmetic is performed.

Examples
Variables
let $d1 := xs:yearMonthDuration("P20Y")
let $d2 := xs:yearMonthDuration("P10M")
let $seq1 := ($d1, $d2)
let $seq3 := (3, 4, 5)
Expression:

sum(($d1, $d2))

Result:

xs:yearMonthDuration("P20Y10M")

Expression:
sum(
  $seq1[. lt xs:yearMonthDuration('P3M')],
  xs:yearMonthDuration('P0M')
)
Result:
xs:yearMonthDuration("P0M")
Expression:

sum($seq3)

Result:

12

Expression:

sum(())

Result:

0

Expression:

sum((),())

Result:

()

Expression:

sum((1 to 100)[. lt 0], 0)

Result:

0

Expression:

sum(($d1, $d2), "ein Augenblick")

Result:

xs:yearMonthDuration("P20Y10M")

(There is no requirement that the $zero value should be the same type as the items in $value, or even that it should belong to a type that supports addition.)

Expression:

sum([ 1, 2, 3 ])

Result:

6

(Atomizing an array returns the sequence obtained by atomizing its members.)

Expression:

sum([ [ 1, 2 ], [ 3, 4 ] ])

Result:

10

(Atomizing an array returns the sequence obtained by atomizing its members.)

fn:sum(($d1, 9E1)) raises a type error [err:FORG0006].

2.5 Basic higher-order functions

The following functions take function items as an argument.

FunctionMeaning
fn:applyMakes a dynamic call on a function with an argument list supplied in the form of an array.
fn:do-untilProcesses a supplied value repeatedly, continuing when some condition is false, and returning the value that satisfies the condition.
fn:everyReturns true if every item in the input sequence matches a supplied predicate.
fn:filterReturns those items from the sequence $input for which the supplied function $predicate returns true.
fn:fold-leftProcesses the supplied sequence from left to right, applying the supplied function repeatedly to each item in turn, together with an accumulated result value.
fn:fold-rightProcesses the supplied sequence from right to left, applying the supplied function repeatedly to each item in turn, together with an accumulated result value.
fn:for-eachApplies the function item $action to every item from the sequence $input in turn, returning the concatenation of the resulting sequences in order.
fn:for-each-pairApplies the function item $action to successive pairs of items taken one from $input1 and one from $input2, returning the concatenation of the resulting sequences in order.
fn:highestReturns a value that is greater than or equal to every other value appearing in the input sequence.
fn:index-whereReturns the positions in an input sequence of items that match a supplied predicate.
fn:lowestReturns those items from a supplied sequence that have the lowest value of a sort key, where the sort key can be computed using a caller-supplied function.
fn:partial-applyPerforms partial application of a function item by binding values to selected arguments.
fn:partitionPartitions a sequence of items into a sequence of non-empty arrays containing the same items, starting a new partition when a supplied condition is true.
fn:scan-leftProduces the sequence of successive partial results from the evaluation of fn:fold-left with the same arguments.
fn:scan-rightProduces the sequence of successive partial results from the evaluation of fn:fold-right with the same arguments.
fn:someReturns true if at least one item in the input sequence matches a supplied predicate.
fn:sortSorts a supplied sequence, based on the value of a sort key supplied as a function.
fn:sort-bySorts a supplied sequence, based on the value of a number of sort keys supplied as functions.
fn:sort-withSorts a supplied sequence, according to the order induced by the supplied comparator functions.
fn:subsequence-whereReturns a contiguous sequence of items from $input, with the start and end points located by applying predicates.
fn:take-whileReturns items from the input sequence prior to the first one that fails to match a supplied predicate.
fn:transitive-closureReturns all the GNodes reachable from a given start GNode by applying a supplied function repeatedly.
fn:while-doProcesses a supplied value repeatedly, continuing while some condition remains true, and returning the first value that does not satisfy the condition.

With all these functions, if the caller-supplied function fails with a dynamic error, this error is propagated as an error from the higher-order function itself.

2.5.3 fn:every

Changes in 4.0 (next | previous)

  1. New in 4.0  [  13 September 2022]

  2. The $predicate callback function may return an empty sequence (meaning false).  [Issue 1171 PR 1182 7 May 2024]

Summary

Returns true if every item in the input sequence matches a supplied predicate.

Signature
fn:every(
$inputas item()*,
$predicateas (fn(item(), xs:integer) as xs:boolean?)?:= fn:boolean#1
) as xs:boolean
Properties

This function is deterministic, context-independent, and focus-independent.

Rules

The function returns true if $input is empty, or if $predicate($item, $pos) returns true for every item $item at position $pos (1-based) in $input.

Formal Equivalent

The effect of the function is equivalent to the result of the following XPath expression.

count(filter($input, $predicate)) = count($input)
Error Conditions

An error is raised if the $predicate function raises an error. In particular, when the default predicate fn:boolean#1 is used, an error is raised if an item has no effective boolean value.

Notes

If the second argument is omitted or an empty sequence, the predicate defaults to fn:boolean#1, which takes the effective boolean value of each item.

It is possible for the supplied $predicate to be a function whose arity is less than two. The coercion rules mean that the additional parameters are effectively ignored. Frequently a predicate function will only consider the item itself, and disregard its position in the sequence.

The predicate is required to return either true, false, or an empty sequence (which is treated as false). A predicate such as fn { self::h1 } results in a type error because it returns a node, not a boolean.

The implementation may deliver a result as soon as one item is found for which the predicate returns false; it is not required to evaluate the predicate for every item, nor is it required to examine items sequentially from left to right.

Examples
Expression:

every(())

Result:

true()

Expression:

every((1 = 1, 2 = 2, 3 = 4))

Result:

false()

Expression:

every((), boolean#1)

Result:

true()

Expression:

every((1, 3, 7), fn { . mod 2 = 1 })

Result:

true()

Expression:

every(-5 to +5, fn { . ge 0 })

Result:

false()

Expression:
every(
  ("January", "February", "March", "April",
   "September", "October", "November", "December"),
  contains(?, "r")
)
Result:
true()
Expression:
every(
  ("January", "February", "March", "April",
   "September", "October", "November", "December")
  =!> contains("r")
)
Result:
true()
Expression:

every((1, 2, number('NaN')))

Result:

false()

(The effective boolean value of NaN is false.)

Expression:

every(1 to 5, fn($num, $pos) { $num = $pos })

Result:

true()

Expression:
let $dl := <dl><dt>Morgawr</dt><dd>Sea giant</dd></dl>
return every($dl/*, fn($elem, $pos) {
  name($elem) = (
    if (($pos mod 2)) then "dt" else "dd"
  )
})
Result:
true()

2.5.9 fn:highest

Changes in 4.0 (next | previous)

  1. New in 4.0  [  20 September 2022]

Summary

Returns a value that is greater than or equal to every other value appearing in the input sequence.

Signature
fn:highest(
$inputas item()*,
$collationas xs:string?:= fn:default-collation(),
$keyas (fn(item()) as xs:anyAtomicType*)?:= fn:data#1
) as item()*
Properties

This function is deterministic, context-dependent, and focus-independent. It depends on collations.

Rules

Any item in $values that is an instance of xs:untypedAtomic is first cast to xs:double. The resulting sequence is referred to as the converted sequence.

All pairs of values in the converted sequence must be mutually comparable. Two values A and B are mutually comparable if fn:compare(A, B) raises no error.

If the converted sequence is empty, the function returns the empty sequence.

If the converted sequence contains the value NaN, the value NaN is returned (as an xs:float or xs:double as appropriate).

Two items A and B from the converted sequence are compared by calling fn:compare(A, B, $collation), where $collation is determined by the rules in 5.3.7 Choosing a collation:

The result of the function is a value from the converted sequence that is greater than or equal to every other value under the above rules. If there is more than one such value, then it is implementation-dependent which of them is returned.

Error Conditions

If the set of computed keys contains xs:untypedAtomic values that are not castable to xs:double then the operation will fail with a dynamic error ([err:FORG0001]FO).

If the set of computed keys contains values that are not comparable using the lt operator then the sort operation will fail with a type error ([err:XPTY0004]XP).

Examples
Variables
let $e := <a x="10" y="5" z="2"/>
Expression:

highest($e/@*) ! name()

Result:

"x"

(By default, untyped values are compared as numbers.)

Expression:

highest($e/@*, (), string#1) ! name()

Result:

"y"

(Here, the attribute values are compared as strings.)

Expression:

highest(("red", "green", "blue"), (), string-length#1)

Result:

"green"

Expression:
highest(
  ("red", "green", "blue"),
  key := {
    "red"  : xs:hexBinary('FF0000'),
    "green": xs:hexBinary('008000'),
    "blue" : xs:hexBinary('0000FF')
  }
)
Result:
"red"
Expression:
highest(
  ("red", "orange", "yellow", "green", "blue", "indigo", "violet"),
  key := string-length#1
)
Result:
"orange", "yellow", "indigo", "violet"
Expression:

highest(1 to 25, (), fn { . idiv 10 })

Result:

20, 21, 22, 23, 24, 25

To find employees having the highest salary:

highest($employees, (), fn { xs:decimal(salary) })

2.5.11 fn:lowest

Changes in 4.0 (next | previous)

  1. New in 4.0  [  20 September 2022]

Summary

Returns those items from a supplied sequence that have the lowest value of a sort key, where the sort key can be computed using a caller-supplied function.

Signature
fn:lowest(
$inputas item()*,
$collationas xs:string?:= fn:default-collation(),
$keyas (fn(item()) as xs:anyAtomicType*)?:= fn:data#1
) as item()*
Properties

This function is deterministic, context-dependent, and focus-independent. It depends on collations.

Rules

The second argument, $collation, defaults to ().

Supplying an empty sequence as $collation is equivalent to supplying fn:default-collation(). For more information on collations see 5.3.7 Choosing a collation.

The third argument defaults to the function data#1.

The collation used by this function is determined according to the rules in 5.3.7 Choosing a collation.

Let $modified-key be the function:

fn($item) {
  $key($item) => data() ! (
    if (. instance of xs:untypedAtomic) then xs:double(.) else .
  )
}

That is, the supplied function for computing key values is wrapped in a function that converts any xs:untypedAtomic values in its result to xs:double. This makes the function consistent with the behavior of fn:min and fn:max, but inconsistent with fn:sort, which treats untyped values as strings.

The result of the function is obtained as follows:

  • If the input is an empty sequence, the result is an empty sequence.

  • The input sequence is sorted, by applying the function fn:sort($input, $collation, $modified-key).

  • Let $C be the selected collation, or the default collation where applicable.

  • Let $B be the first item in the sorted sequence.

  • The function returns those items $A from the input sequence that are contextually equal to $B, retaining their order.

Error Conditions

If the set of computed keys contains xs:untypedAtomic values that are not castable to xs:double then the operation will fail with a dynamic error ([err:FORG0001]FO).

If the set of computed keys contains values that are not comparable using the lt operator then the sort operation will fail with a type error ([err:XPTY0004]XP).

Examples
Variables
let $e := <a x="10" y="5" z="2"/>
Expression:

lowest($e/@*) ! name()

Result:

"z"

(By default, untyped values are compared as numbers.)

Expression:

lowest($e/@*, (), string#1) ! name()

Result:

"x"

(Here, the attribute values are compared as strings.)

Expression:

lowest(("red", "green", "blue"), (), string-length#1)

Result:

"red"

Expression:
lowest(
  ("red", "green", "blue"),
  key := {
    "red"  : xs:hexBinary('FF0000'),
    "green": xs:hexBinary('008000'),
    "blue" : xs:hexBinary('0000FF')
  }
)
Result:
"blue"
Expression:
lowest(
  ("April", "June", "July", "August"),
  key := string-length#1
)
Result:
"June", "July"
Expression:

lowest(1 to 25, (), fn { . idiv 10 })

Result:

1, 2, 3, 4, 5, 6, 7, 8, 9

To find employees having the lowest salary:

lowest($employees, (), fn { xs:decimal(salary) })

2.5.16 fn:some

Changes in 4.0 (next | previous)

  1. New in 4.0  [  13 September 2022]

  2. The $predicate callback function may return an empty sequence (meaning false).  [Issue 1171 PR 1182 7 May 2024]

Summary

Returns true if at least one item in the input sequence matches a supplied predicate.

Signature
fn:some(
$inputas item()*,
$predicateas (fn(item(), xs:integer) as xs:boolean?)?:= fn:boolean#1
) as xs:boolean
Properties

This function is deterministic, context-independent, and focus-independent.

Rules

The function returns true if (and only if) there is an item $item at position $pos in the input sequence such that $predicate($item, $pos) returns true.

Formal Equivalent

The effect of the function is equivalent to the result of the following XPath expression.

exists(filter($input, $predicate))
Error Conditions

An error is raised if the $predicate function raises an error. In particular, when the default predicate fn:boolean#1 is used, an error is raised if an item has no effective boolean value.

Notes

If the second argument is omitted or an empty sequence, the predicate defaults to fn:boolean#1, which takes the effective boolean value of each item.

It is possible for the supplied $predicate to be a function whose arity is less than two. The coercion rules mean that the additional parameters are effectively ignored. Frequently a predicate function will only consider the item itself, and disregard its position in the sequence.

The predicate is required to return either true, false, or an empty sequence (which is treated as false). A predicate such as fn { self::h1 } results in a type error because it returns a node, not a boolean.

The implementation may deliver a result as soon as one item is found for which the predicate returns true; it is not required to evaluate the predicate for every item, nor is it required to examine items sequentially from left to right.

Examples
Expression:

some(())

Result:

false()

Expression:

some((1 = 1, 2 = 2, 3 = 4))

Result:

true()

Expression:

some((), boolean#1)

Result:

false()

Expression:

some((1, 3, 7), fn { . mod 2 = 1 })

Result:

true()

Expression:

some(-5 to +5, fn { . ge 0 })

Result:

true()

Expression:
some(
  ("January", "February", "March", "April",
   "September", "October", "November", "December"),
  contains(?, "z")
)
Result:
false()
Expression:
some(
  ("January", "February", "March", "April",
   "September", "October", "November", "December")
  =!> contains("r")
)
Result:
true()
Expression:

some(("", 0, number('NaN')))

Result:

false()

(The effective boolean value in each case is false.)

Expression:

some(reverse(1 to 5), fn($num, $pos) { $num = $pos })

Result:

true()

2.5.17 fn:sort

Summary

Sorts a supplied sequence, based on the value of a sort key supplied as a function.

Signature
fn:sort(
$inputas item()*,
$collationas xs:string?:= fn:default-collation(),
$keyas fn(item()) as xs:anyAtomicType*:= fn:data#1
) as item()*
Properties

This function is deterministic, context-dependent, and focus-independent. It depends on collations.

Rules

This function is retained for compatibility from version 3.1 of this specification. Version 4.0 introduces two more powerful functions, fn:sort-by and fn:sort-with.

The function call fn:sort($input, $collation, $key) is defined to have the same effect as the call fn:sort-by($input, { 'key': $key, 'collation': $collation, 'order': 'ascending'}). See fn:sort-by.

The result of the function is a sequence that contains all the items from $input, typically in a different order, the order being defined by the supplied sort key definitions.

Formal Equivalent

The effect of the function is equivalent to the result of the following XPath expression.

fn:sort-by($input, { 'key':$key, 'collation':$collation, 'order':'ascending' })
Error Conditions

If the set of computed sort keys contains values that are not comparable using the lt operator then the sort operation will fail with a type error ([err:XPTY0004]XP).

Examples
Expression:

sort((1, 4, 6, 5, 3))

Result:

1, 3, 4, 5, 6

Expression:

sort((1, -2, 5, 10, -10, 10, 8), (), abs#1)

Result:

1, -2, 5, 8, 10, -10, 10

To sort a set of strings $in using Swedish collation:

let $SWEDISH := collation({ 'lang': 'se' })
return sort($in, $SWEDISH)

To sort a sequence of employees by last name as the major sort key and first name as the minor sort key, using the default collation:

sort($employees, (), fn { name ! (last, first) })

2.5.20 fn:subsequence-where

Changes in 4.0 (next | previous)

  1. New in 4.0  [Issue 878 PR 940 5 February 2024]

Summary

Returns a contiguous sequence of items from $input, with the start and end points located by applying predicates.

Signature
fn:subsequence-where(
$inputas item()*,
$fromas (fn(item(), xs:integer) as xs:boolean?)?:= true#0,
$toas (fn(item(), xs:integer) as xs:boolean?)?:= false#0
) as item()*
Properties

This function is deterministic, context-independent, and focus-independent.

Rules

Informally, the function returns the subsequence of $input starting with the first item that matches the $from predicate, and ending with the first subsequent item that matches the $to predicate. If $from is not suppliedtrue#0, it defaults to the start of matches for the first item$input; if $to is not suppliedfalse#0, it defaults to the end of accepts all remaining items$input. If $from does not match any items in $input, the result is the empty sequence; if $to does not match any items, all items up to the last are included in the result.

Formal Equivalent

The effect of the function is equivalent to the result of the following XPath expression.

let $start := index-where($input, $from)[1] otherwise count($input) + 1
let $end   := index-where($input, $to)[. ge $start][1] otherwise count($input) + 1
return slice($input, $start, $end)
Notes

The result includes both the item that matches the $from condition and the item that matches the $to condition. To select a subsequence that starts after the $from item, apply the fn:tail function to the result. To select a subsequence that ends before the $to item, apply the fn:trunk function to the result.

The predicate functions supplied to the $from and $to parameters can include an integer position argument as well as the item itself. This position will always be 1-based, relative to the start of $input. This means it is possible to select items based on their absolute position in the $input sequence, but there is no mechanism to select an end position relative to the start position. If this is needed, the function can be combined with others: for example, to select a subsequence of four items starting with "Barbara", use $input => subsequence-where(fn { . eq "Barbara" }) => slice(end := 4).

If the requirement is to select all elements stopping before the first h2 element if it exists, or up to the end of the sequence otherwise, the simplest solution is perhaps to write:

slice($input, end:=index-where($input, fn { boolean(self::h2) })[1])

A return value of () from the $from or $to predicate is treated as false.

Examples
Variables
let $names := ("Anna", "Barbara", "Catherine", "Delia",  "Eliza", "Freda",
  "Gertrude", "Hilda")
Expression:

subsequence-where($names, starts-with(?, "E"))

Result:

"Eliza", "Freda", "Gertrude", "Hilda"

Expression:

subsequence-where($names, to := starts-with(?, "D"))

Result:

"Anna", "Barbara", "Catherine", "Delia"

Expression:

subsequence-where($names, to := starts-with(?, "D")) => trunk()

Result:

"Anna", "Barbara", "Catherine"

Expression:

subsequence-where($names, starts-with(?, "E"), starts-with(?, "G"))

Result:

"Eliza", "Freda", "Gertrude"

Expression:
subsequence-where(
  $names,
  starts-with(?, "D"), fn { string-length(.) gt 5 }
)
Result:
"Delia", "Eliza", "Freda", "Gertrude"
Expression:

subsequence-where($names, starts-with(?, "M"))

Result:

()

Expression:

subsequence-where($names, starts-with(?, "G"), starts-with(?, "Z"))

Result:

"Gertrude", "Hilda"

Expression:

subsequence-where($names)

Result:
"Anna", "Barbara", "Catherine", "Delia", "Eliza", "Freda",
  "Gertrude", "Hilda"
Expression:
subsequence-where(
  $names,
  fn($it, $pos) { ends-with($it, "a") and $pos gt 5 }
)
Result:
"Freda", "Gertrude", "Hilda"
Expression:
subsequence-where(
  $names, 
  to := fn($it, $pos) { ends-with($it, "a") and $pos ge 5 }
)
Result:
"Anna", "Barbara", "Catherine", "Delia", "Eliza"

4 Processing numerics

This section specifies arithmetic operators on the numeric datatypes defined in [XML Schema Part 2: Datatypes Second Edition].

4.4 Functions on numeric values

The following functions are defined on numeric types. Each function returns a value of the same type as the type of its argument.

  • If the argument is the empty sequence, the empty sequence is returned.

  • For xs:float and xs:double arguments, if the argument is NaN, NaN is returned.

  • With the exception of fn:abs, functions with arguments of type xs:float and xs:double that are positive or negative infinity return positive or negative infinity.

FunctionMeaning
fn:absReturns the absolute value of $value.
fn:ceilingRounds $value upwards to a whole number.
fn:divide-decimalsDivides one xs:decimal by another to a defined precision, returning both the quotient and the remainder.
fn:floorRounds $value downwards to a whole number.
fn:is-NaNReturns true if the argument is the xs:float or xs:double value NaN.
fn:roundRounds a value to a specified number of decimal places, with control over how the rounding takes place.
fn:round-half-to-evenRounds a value to a specified number of decimal places, rounding to make the last digit even if two such values are equally near.

Note:

The fn:round function has been extended with a third argument in version 4.0 of this specification; this means that the fn:ceiling, fn:floor, and fn:round-half-to-even functions are now technically redundant. They are retained, however, both for backwards compatibility and for convenience.

4.4.3 fn:divide-decimals

Changes in 4.0 (next | previous)

  1. New in 4.0.  [Issue 1261 PR 1671 1 January 2025]

Summary

Divides one xs:decimal by another to a defined precision, returning both the quotient and the remainder.

Signature
fn:divide-decimals(
$valueas xs:decimal,
$divisoras xs:decimal,
$precisionas xs:integer?:= 0
) as record(quotient as xs:decimal, remainder as xs:decimal)
Properties

This function is deterministic, context-independent, and focus-independent.

Rules

The function returns a record with two fields:

  1. quotient is the xs:decimal value furthest from zero such that:

    1. quotient is an exact multiple of ten to the power of minus $precision;

    2. the absolute value of quotient multipled by $divisor is less than or equal to the absolute value of $value;

    3. the sign of quotient is the same as the sign of op:numeric-divide($value, $divisor).

  2. remainder is the exact result of subtracting quotient multiplied by $divisor from $value.

There may be implementation-defined limits on the precision available. If the requested $precision is outside this range, it should be adjusted to the nearest value supported by the implementation.

Error Conditions

A dynamic error is raised [err:FOAR0001] if $divisor is zero.

Examples
ExpressionResult
divide-decimals(120.6, 60.3, 4)

{ "quotient": 2, "remainder": 0 }

divide-decimals(10, 3)

{ "quotient": 3, "remainder": 1 }

divide-decimals(10, -3)

{ "quotient": -3, "remainder": 1 }

divide-decimals(-10, 3)

{ "quotient": -3, "remainder": -1 }

divide-decimals(-10, -3)

{ "quotient": 3, "remainder": -1 }

divide-decimals(10, 3, 6)

{ "quotient": 3.333333, "remainder": 0.000001 }

divide-decimals(100, 30)

{ "quotient": 3, "remainder": 10 }

divide-decimals(150_862, 7, -3)

{ "quotient": 21_000, "remainder": 3_862 }

4.4.6 fn:round

Changes in 4.0 (next | previous)

  1. A third argument has been added, providing control over the rounding mode.  [Issues 1187 1274 PRs 1260 1275 11 June 2024]

  2. It is explicitly stated that the limits for $precision are implementation-defined.  [Issue 1705 PR 1711 1 January 2025]

Summary

Rounds a value to a specified number of decimal places, with control over how the rounding takes place.

Signature
fn:round(
$valueas xs:numeric?,
$precisionas xs:integer?:= 0,
$modeas enum('floor', 'ceiling', 'toward-zero', 'away-from-zero', 'half-to-floor', 'half-to-ceiling', 'half-toward-zero', 'half-away-from-zero', 'half-to-even')?:= 'half-to-ceiling'
) as xs:numeric?
Properties

This function is deterministic, context-independent, and focus-independent.

Rules

General rules: see 4.4 Functions on numeric values.

The function returns a value that is close to $value and that is a multiple of ten to the power of minus $precision. The default value of $precision is zero, in which case the function returns a whole number (but not necessarily an xs:integer).

The detailed way in which rounding is performed depends on the value of $mode, as follows. Here L means the highest multiple of ten to the power of minus $precision that is less than or equal to $value, U means the lowest multiple of ten to the power of minus $precision that is greater than or equal to $value, N means the multiple of ten to the power of minus $precision that is numerically closest to $value, and midway means that $value is equal to the arithmetic mean of L and U.

Rounding Modes
Rounding ModeMeaning

'floor'

Returns L.

'ceiling'

Returns U.

'toward-zero'

Returns L if $value is positive, otherwise U.

'away-from-zero'

Returns U if $value is positive, otherwise L

'half-to-floor'

Returns N, unless midway, in which case L.

'half-to-ceiling'

Returns N, unless midway, in which case U. This is the default.

'half-toward-zero'

Returns N, unless midway, in which case it returns L if $value is positive, otherwise U.

'half-away-from-zero'

Returns N, unless midway, in which case it returns U if $value is positive, otherwise L.

'half-to-even'

Returns N, unless midway, in which case it returns whichever of L and U has a last significant digit that is even.

For the four types xs:float, xs:double, xs:decimal and xs:integer, it is guaranteed that if the type of $value is an instance of type T then the result will also be an instance of T. The result may also be an instance of a type derived from one of these four by restriction. For example, if $value is an instance of xs:decimal and $precision is less than one, then the result may be an instance of xs:integer.

If the second argument is omitted or is an empty sequence, the function produces the same result as when $precision = 0 (that is, it rounds to a whole number).

When $value is of type xs:float and xs:double:

  1. If $value is NaN, positive or negative zero, or positive or negative infinity, then the result is the same as the argument.

  2. For other values, the argument is cast to xs:decimal using an implementation of xs:decimal that imposes no limits on the number of digits that can be represented. The function is applied to this xs:decimal value, and the resulting xs:decimal is cast back to xs:float or xs:double as appropriate to form the function result. If the resulting xs:decimal value is zero, then positive or negative zero is returned according to the sign of $value.

There may be implementation-defined limits on the precision available. If the requested $precision is outside this range, it should be adjusted to the nearest value supported by the implementation.

Notes

This function is typically used with a non-zero $precision in financial applications where the argument is of type xs:decimal. For arguments of type xs:float and xs:double the results may be counter-intuitive. For example, consider round(35.425e0, 2). The result is not 35.43, as might be expected, but 35.42. This is because the xs:double written as 35.425e0 has an exact value equal to 35.42499999999..., which is closer to 35.42 than to 35.43.

The call round($v, 0, "floor") is equivalent to floor($v).

The call round($v, 0, "ceiling") is equivalent to ceiling($v).

The call round($v, $p, "half-to-even") is equivalent to round-half-to-even($v, $p).

Examples
ExpressionResult
round(2.5)

3.0

round(2.4999)

2.0

round(-2.5)

-2.0

round(1.125, 2)

1.13

round(8452, -2)

8500

round(3.1415e0, 2)

3.14e0

math:log(0) => round()

-xs:double('INF')

round(1.7, 0, "floor")

1

round(-1.7, 0, "floor")

-2

round(1.7, 0, "ceiling")

2

round(-1.7, 0, "ceiling")

-1

round(1.7, 0, "toward-zero")

1

round(-1.7, 0, "toward-zero")

-1

round(1.7, 0, "away-from-zero")

2

round(-1.7, 0, "away-from-zero")

-2

round(1.125, 2, "half-to-floor")

1.12

round(-1.125, 2, "half-to-floor")

-1.13

round(1.125, 2, "half-to-ceiling")

1.13

round(-1.125, 2, "half-to-ceiling")

-1.12

round(1.125, 2, "half-toward-zero")

1.12

round(-1.125, 2, "half-toward-zero")

-1.12

round(1.125, 2, "half-away-from-zero")

1.13

round(-1.125, 2, "half-away-from-zero")

-1.13

round(1.125, 2, "half-to-even")

1.12

round(-1.125, 2, "half-to-even")

-1.12

4.4.7 fn:round-half-to-even

Changes in 4.0 (next | previous)

  1. It is explicitly stated that the limits for $precision are implementation-defined.  [Issue 1705 PR 1711 1 January 2025]

Summary

Rounds a value to a specified number of decimal places, rounding to make the last digit even if two such values are equally near.

Signature
fn:round-half-to-even(
$valueas xs:numeric?,
$precisionas xs:integer?:= 0
) as xs:numeric?
Properties

This function is deterministic, context-independent, and focus-independent.

Rules

General rules: see 4.4 Functions on numeric values.

The function returns the nearest (that is, numerically closest) value to $value that is a multiple of ten to the power of minus $precision. If two such values are equally near (e.g. if the fractional part in $value is exactly .500...), the function returns the one whose least significant digit is even.

For the four types xs:float, xs:double, xs:decimal and xs:integer, it is guaranteed that if the type of $value is an instance of type T then the result will also be an instance of T. The result may also be an instance of a type derived from one of these four by restriction. For example, if $value is an instance of xs:decimal and $precision is less than one, then the result may be an instance of xs:integer.

If the second argument is omitted or an empty sequence, the function produces the same result as the two-argument version with $precision = 0.

For arguments of type xs:float and xs:double:

  1. If the argument is NaN, positive or negative zero, or positive or negative infinity, then the result is the same as the argument.

  2. In all other cases, the argument is cast to xs:decimal using an implementation of xs:decimal that imposes no limits on the number of digits that can be represented. The function is applied to this xs:decimal value, and the resulting xs:decimal is cast back to xs:float or xs:double as appropriate to form the function result. If the resulting xs:decimal value is zero, then positive or negative zero is returned according to the sign of the original argument.

There may be implementation-defined limits on the precision available. If the requested $precision is outside this range, it should be adjusted to the nearest value supported by the implementation.

Notes

This function is typically used in financial applications where the argument is of type xs:decimal. For arguments of type xs:float and xs:double the results may be counter-intuitive. For example, consider round-half-to-even(xs:float(150.015), 2). The result is not 150.02 as might be expected, but 150.01. This is because the conversion of the xs:float value represented by the literal 150.015 to an xs:decimal produces the xs:decimal value 150.014999389..., which is closer to 150.01 than to 150.02.

From 4.0, the effect of this function can also be achieved by calling fn:round with the third argument set to "half-to-even".

Examples
ExpressionResult
round-half-to-even(0.5)

0.0

round-half-to-even(1.5)

2.0

round-half-to-even(2.5)

2.0

round-half-to-even(3.567812e+3, 2)

3567.81e0

round-half-to-even(4.7564e-3, 2)

0.0e0

round-half-to-even(35612.25, -2)

35600

math:log(0) => round-half-to-even()

-xs:double('INF')

4.5 Parsing numbers

It is possible to convert strings to values of type xs:integer, xs:float, xs:decimal, or xs:double using the constructor functions described in 22 Constructor functions or using cast expressions as described in 23 Casting.

In addition the fn:number function is available to convert strings to values of type xs:double. It differs from the xs:double constructor function in that any value outside the lexical space of the xs:double datatype is converted to the xs:double value NaN.

FunctionMeaning
fn:numberReturns the value indicated by $value or, if $value is not specified, the context value after atomization, converted to an xs:double.
fn:parse-integerConverts a string to an integer, recognizing any radix in the range 2 to 36.

4.5.1 fn:number

Summary

Returns the value indicated by $value or, if $value is not specified, the context value after atomization, converted to an xs:double.

Signature
fn:number(
$valueas xs:anyAtomicType?:= .
) as xs:double
Properties

The zero-argument form of this function is deterministic, context-dependent, and focus-dependent.

The one-argument form of this function is deterministic, context-independent, and focus-independent.

Rules

Calling the zero-argument version of the function is defined to give the same result as calling the single-argument version with the context value (.). That is, fn:number() is equivalent to fn:number(.), as defined by the rules that follow.

If $value is the empty sequence or if $value cannot be converted to an xs:double, the xs:double value NaN is returned.

Otherwise, $value is converted to an xs:double following the rules of 23.1.3.2 Casting to xs:double. If the conversion to xs:double fails, the xs:double value NaN is returned.

Error Conditions

A type error is raised [err:XPDY0002]XP if $value is omitted and the context value is absentDM.

As a consequence of the rules given above, a type error is raised [err:XPTY0004]XP if the context value cannot be atomized, or if the result of atomizing the context value is a sequence containing more than one atomic item.

Notes

XSD 1.1 allows the string +INF as a representation of positive infinity; XSD 1.0 does not. It is implementation-defined whether XSD 1.1 is supported.

Generally fn:number returns NaN rather than raising a dynamic error if the argument cannot be converted to xs:double. However, a type error is raised in the usual way if the supplied argument cannot be atomized or if the result of atomization does not match the required argument type.

Examples
Variables
let $e := <e price="12.1" discount="NONE"/>
ExpressionResult
number(12)

1.2e1

number('12')

1.2e1

number('INF')

xs:double('INF')

number('NaN')

xs:double('NaN')

number('non-numeric')

xs:double('NaN')

number($e/@price)

1.21e1

number($e/@discount)

xs:double('NaN')

number($e/@misspelt)

xs:double('NaN')

("10", "11", "12") ! number()

1.0e1, 1.1e1, 1.2e1

4.5.2 fn:parse-integer

Changes in 4.0 (next | previous)

  1. New in 4.0  [Issue 241 PR 434 25 April 2023]

Summary

Converts a string to an integer, recognizing any radix in the range 2 to 36.

Signature
fn:parse-integer(
$valueas xs:string?,
$radixas xs:integer?:= 10
) as xs:integer?
Properties

This function is deterministic, context-independent, and focus-independent.

Rules

If $value is an empty sequence, the result is an empty sequence.

The supplied $radix must be in the range 2 to 36 inclusive.

The string $value is preprocessed by stripping all whitespace characters (including internal whitespace) and underscore characters.

After this process, the supplied value must consist of an optional sign (+ or -) followed by a sequence of one or more generalized digits drawn from the first $radix characters in the alphabet 0123456789abcdefghijklmnopqrstuvwxyz; upper-case alphabetics A-Z may be used in place of their lower-case equivalents.

The value of a generalized digit corresponds to its position in this alphabet.

Formal Equivalent

The effect of the function is equivalent to the result of the following XPath expression, except in error cases.

let $alphabet := characters("0123456789abcdefghijklmnopqrstuvwxyz")
let $preprocessed := translate(
  $value, 
  codepoints-to-string((9, 10, 13, 32, 95)), 
  ""
)
let $digits := translate($preprocessed, "+-", "")
let $abs := sum(
  for $char at $p in reverse(characters(lower-case($digits)))
  return (index-of($alphabet, $char) - 1) * xs:integer(math:pow($radix, $p - 1))
)
return if (starts-with($preprocessed, "-")) then -$abs else +$abs
Error Conditions

A dynamic error is raised [err:FORG0011] if $radix is not in the range 2 to 36.

A dynamic error is raised [err:FORG0012] if, after stripping whitespace and underscores and the optional leading sign, $value is a zero-length string, or if it contains a character that is not among the first $radix characters in the alphabet 0123456789abcdefghijklmnopqrstuvwxyz, or the upper-case equivalent of such a character.

A dynamic error is raised [err:FOCA0003] if the value of the resulting integer exceeds the implementation-dependent limit on the size of an xs:integer.

Notes

When $radix takes its default value of 10, the function delivers the same result as casting $value (after removal of whitespace and underscores) to xs:integer.

If underscores or whitespace in the input need to be rejected, then the string should first be validated, perhaps using fn:matches.

If other characters may legitimately appear in the input, for example a leading 0x, then this must first be removed by pre-processing the input.

If the input uses a different family of digits, then the value should first be converted to the required digits using fn:translate.

A string in the lexical space of xs:hexBinary will always be an acceptable input, provided it is not too long. So, for example, the expression "1DE=" => xs:base64Binary() => xs:hexBinary() => xs:string() => parse-integer(16) can be used to convert the Base 64 value 1DE= to the integer 54321, via the hexadecimal string D431.

Examples
Expression:

parse-integer(" 200 ")

Result:

200

Expression:

parse-integer("-20")

Result:

-20

Expression:

parse-integer(" +100")

Result:

100

Expression:

parse-integer("ff", 16)

Result:

255

Expression:

parse-integer("FFFF FFFF", 16)

Result:

4294967295

Expression:

parse-integer("-FFFF_FFFF", 16)

Result:

-4294967295

Expression:

parse-integer("377", 8)

Result:

255

Expression:

parse-integer("101", 2)

Result:

5

Expression:

parse-integer("vv", 32)

Result:

1023

Alphabetic base-26 numbering systems (hexavigesimal) can be parsed via translation. Note, enumerating systems that do not assign a symbol to zero (e.g., spreadsheet columns) must be preprocessed in a different fashion.

Expression:
lower-case("AAB")
=> translate("abcdefghijklmnopqrstuvwxyz", "0123456789abcdefghijklmnop")
=> parse-integer(26)
Result:
1

Digit-based numeration systems comparable to the Arabic numbers 0 through 9 can be parsed via translation.

Expression:
translate(value := '٢٠٢٣', replace := '٠١٢٣٤٥٦٧٨٩', with := '0123456789')
=> parse-integer()
Result:
2023

4.7 Formatting numbers

This section defines a function for formatting decimal and floating point numbers.

FunctionMeaning
fn:format-numberReturns a string containing a number formatted according to a given picture string and decimal format.

Note:

This function can be used to format any numeric quantity, including an integer. For integers, however, the fn:format-integer function offers additional possibilities. Note also that the picture strings used by the two functions are not 100% compatible, though they share some options in common.

4.7.2 fn:format-number

Changes in 4.0 (next | previous)

  1. The decimal format name can now be supplied as a value of type xs:QName, as an alternative to supplying a lexical QName as an instance of xs:string.  [Issue 780 PR 925 9 January 2024]

  2. Decimal format parameters can now be supplied directly as a map in the third argument, rather than referencing a format defined in the static context.  [Issues 340 1138 PRs 1049 1151 5 March 2024]

  3. For selected properties including percent and exponent-separator, it is now possible to specify a single-character marker to be used in the picture string, together with a multi-character rendition to be used in the formatted output.  [Issue 1048 PR 1250 11 June 2024]

Summary

Returns a string containing a number formatted according to a given picture string and decimal format.

Signature
fn:format-number(
$valueas xs:numeric?,
$pictureas xs:string,
$optionsas (xs:string | map(*))?:= (){}
) as xs:string
Properties

The two-argument form of this function is deterministic, context-independent, and focus-independent.

The three-argument form of this function is deterministic, context-dependent, and focus-independent. It depends on decimal formats, and namespaces.

Rules

The function formats $value as a string using the picture string specified by the $picture argument and a decimal format.

The $value argument may be of any numeric data type (xs:double, xs:float, xs:decimal, or their subtypes including xs:integer). Note that if an xs:decimal is supplied, it is not automatically converted to an xs:double, as such conversion can involve a loss of precision.

If the supplied value of the $value argument is an empty sequence, the function behaves as if the supplied value were the xs:double value NaN.

If $options is absent, or if it is supplied as an empty sequence or an emptyan empty map, then the number is formatted using the properties of the unnamed decimal format in the static context.

For backwards compatibility reasons, the decimal format can be supplied as an instance of xs:string. If the value of the $options argument is an xs:string, then its value must be a string which after removal of leading and trailing whitespace is in the form of an EQName as defined in the XPath 4.0 grammar, that is one of the following:

  • A lexical QName, which is expanded using the statically known namespaces. The default namespace is not used (no prefix means no namespace).

  • A URIQualifiedName using the syntax Q{uri}local, where the URI can be zero-length to indicate a name in no namespace.

The effective value of the $options argument is then the map { 'format-name': $FN } where $FN is the xs:QName result of expanding this EQName.

The entries that may appear in the $options map are as follows. The option parameter conventions apply. The detailed rules for the interpretation of each option appear later.

In the table, the type xs:string (: matching '.' :) represents a single-character string, that is, a restriction of xs:string with the facet pattern=".", while the type xs:string (: matching '.|.:.*' :) indicates a string that is either a single character, or a single character followed by U+003A (COLON, :) followed by an arbitrary string. Such a property identifies two values: a single character called the marker, which is used to represent the property in the picture string; and an arbitrary string called the rendition which is used to represent in the property in the result string. In the absence of the colon the single character value is used both as the marker and the rendition.

The default value for absent options (other than format-name) is taken from a decimal format in the static context; the default values shown in the table are the values used if no specific value is assigned in the static context.

record(
format-name?as (xs:NCName | xs:QName)?,
decimal-separator?as xs:string (: matching '.|.:.*' :),
grouping-separator?as xs:string (: matching '.|.:.*' :),
exponent-separator?as xs:string (: matching '.|.:.*' :),
infinity?as xs:string,
minus-sign?as xs:string,
NaN?as xs:string,
percent?as xs:string (: matching '.|.:.*' :),
per-mille?as xs:string (: matching '.|.:.*' :),
zero-digit?as xs:string (: matching '.' :),
digit?as xs:string (: matching '.' :),
pattern-separator?as xs:string (: matching '.' :)
)
KeyMeaning

format-name?

The name of a decimal format in the static context; if absent, the unnamed decimal format in the static context is used. An xs:NCName represents the local part of an xs:QName in no namespace.
  • Type: (xs:NCName | xs:QName)?

  • Default: ()

decimal-separator?

The marker used to represent the decimal point in the picture string, and the rendition of the decimal point in the formatted number.
  • Type: xs:string (: matching '.|.:.*' :)

  • Default: "."

grouping-separator?

The marker used to separate groups of digits in the picture string, and the rendition of the grouping separator in the formatted number.
  • Type: xs:string (: matching '.|.:.*' :)

  • Default: ","

exponent-separator?

The marker used to separate the mantissa from the exponent in scientific notation in the picture string, and the rendition of the exponent separator in the formatted number.
  • Type: xs:string (: matching '.|.:.*' :)

  • Default: "e"

infinity?

The string used to represent the value positive or negative infinity in the formatted number.
  • Type: xs:string

  • Default: "Infinity"

minus-sign?

The string used as a minus sign in the formatted number if there is no subpicture for formatting negative numbers.
  • Type: xs:string

  • Default: "-"

NaN?

The string used to represent the value NaN in the formatted number.
  • Type: xs:string

  • Default: "NaN"

percent?

The marker used to indicate the presence of a percent sign in the picture string, and the rendition of the percent sign in the formatted number.
  • Type: xs:string (: matching '.|.:.*' :)

  • Default: "%"

per-mille?

marker used to indicate the presence of a per-mille sign in the picture string, and the rendition of the per-mille sign in the formatted number.
  • Type: xs:string (: matching '.|.:.*' :)

  • Default: "‰" (0x2030)

zero-digit?

Defines the characters used in the picture string to represent a mandatory digit: for example, if the zero-digit is 0 then any of the digits 0 to 9 may be used (interchangeably) in the picture string to represent a mandatory digit, and in the formatted number the characters 0 to 9 will be used to represent the digits zero to nine. The value must be a character in Unicode category Nd with decimal digit value 0 (zero).
  • Type: xs:string (: matching '.' :)

  • Default: "0"

digit?

The character used in the picture string to represent an optional digit.
  • Type: xs:string (: matching '.' :)

  • Default: "#"

pattern-separator?

The character used in the picture string to separate the positive and negative subpictures.
  • Type: xs:string (: matching '.' :)

  • Default: ";"

A base decimal format is established as follows:

  • If the format-name option is present, then the decimal format in the static context identified by this name.

  • Otherwise, the unnamed decimal format in the static context.

The base decimal format is then modified using the other entries in the supplied $options map.

The evaluation of the fn:format-number function takes place in two phases, an analysis phase described in 4.7.4 Analyzing the picture string and a formatting phase described in 4.7.5 Formatting the number.

The analysis phase takes as its inputs the picture string and the variables derived from the relevant decimal format in the static context, and produces as its output a number of variables with defined values. The formatting phase takes as its inputs the number to be formatted and the variables produced by the analysis phase, and produces as its output a string containing a formatted representation of the number.

The result of the function is the formatted string representation of the supplied number.

Error Conditions

A dynamic error is raised [err:FODF1280] if the $options argument is supplied as an xs:string that is neither a valid lexical QName nor a valid URIQualifiedName, or if it uses a prefix that is not found in the statically known namespaces; or if the static context does not contain a declaration of a decimal format with a matching expanded QName; or if $options?format-name is present and the static context does not contain a declaration of a decimal format whose name matches $options?format-name. If the processor is able to detect the error statically (for example, when the argument is supplied as a string literal), then the processor may optionally signal this as a static error.

A dynamic error is raised [err:FODF1290] if a value of $format is not valid for the associated property, or if the properties of the decimal format resulting from a supplied $options map do not have distinct values.

Notes

A string is an ordered sequence of characters, and this specification uses terms such as “left” and “right”, “preceding” and “following” in relation to this ordering, irrespective of the position of the characters when visually rendered on some output medium. Both in the picture string and in the result string, digits with higher significance (that is, representing higher powers of ten) always precede digits with lower significance, even when the rendered text flow is from right to left.

In previous versions of XSLT and XQuery, decimal formats were typically defined in the static context using custom declarations (<xsl:decimal-format> in XSLT, declare decimal-format in XQuery) and then selected by name in a call on fn:format-number. This mechanism remains available, but in 4.0, it may be more convenient to dispense with these declarations, and instead to define a decimal format as a map bound to a global variable, which can be referenced in the $options argument of the fn:format-number call.

Examples

The following examples assume a default decimal format in which the chosen digits are the ASCII digits 0-9, the decimal separator is ., the grouping separator is ,, the minus-sign is -, and the percent-sign is %.

Expression:

format-number(12345.6, '#,###.00')

Result:

"12,345.60"

Expression:

format-number(12345678.9, '9,999.99')

Result:

"12,345,678.90"

Expression:

format-number(123.9, '9999')

Result:

"0124"

Expression:

format-number(0.14, '01%')

Result:

"14%"

Expression:

format-number(0.14, '01%', { 'percent': '%:pc' })

Result:

"14pc"

Expression:
format-number(12345, '0.0###^0', { 
   'exponent-separator': '^:×10^' 
})
Result:
"1.2345×10^4"
Expression:

format-number(-6, '000')

Result:

"-006"

Expression:
format-number(1234567.8, '0.000,0', {
   'grouping-separator': '.',
   'decimal-separator': ','
 })
Result:
"1.234.567,8"

The following examples assume the existence of a decimal format named de in which the grouping separator is . and the decimal separator is ,:

Expression:

format-number(1234.5678, '#.##0,00', { 'format-name': 'de' })

Result:

"1.234,57"

Expression:
format-number(12345, '0,###^0', {
  'format-name': 'de',
  'exponent-separator': '^'
})
Result:
"1,234^4"
Expression:
format-number(12345, '0,###^0', {
  'format-name': 'de',
  'exponent-separator': '^:×10^'
})
Result:
"1,234×10^4"

The following examples assume that the exponent separator in decimal format fortran is E:

Expression:

format-number(1234.5678, '00.000E0', 'fortran')

Result:

"12.346E2"

Expression:

format-number(0.234, '0.0E0', 'fortran')

Result:

"2.3E-1"

Expression:

format-number(0.234, '#.00E0', 'fortran')

Result:

"0.23E0"

Expression:

format-number(0.234, '.00E0', 'fortran')

Result:

".23E0"

4.9 Random Numbers

FunctionMeaning
fn:random-number-generatorReturns a random number generator, which can be used to generate sequences of random numbers.

The function makes use of the record structure defined in the next section.

4.9.2 fn:random-number-generator

Changes in 4.0 (next | previous)

  1. The 3.1 specification suggested that every value in the result range should have the same chance of being chosen. This has been corrected to say that the distribution should be arithmetically uniform (because there are as many xs:double values between 0.01 and 0.1 as there are between 0.1 and 1.0).

Summary

Returns a random number generator, which can be used to generate sequences of random numbers.

Signature
fn:random-number-generator(
$seedas xs:anyAtomicType?:= ()
) as random-number-generator-record
Properties

This function is deterministic, context-independent, and focus-independent.

Rules

The function returns a random number generator. A random number generator is represented as a value of type random-number-generator-record, defined in 4.9.1 Record fn:random-number-generator-record.

Calling the fn:random-number-generator function with no arguments is equivalent to calling the single-argument form of the function with an implementation-dependent seed.

Calling the fn:random-number-generator function with an empty sequence as $seed is equivalent to calling the single-argument form of the function with an implementation-dependent seed.

If a $seed is supplied, it may be an atomic item of any type.

Both forms of the function are deterministic: calling the function twice with the same arguments, within a single execution scope, produces the same results.

The value of the number entry should be such that the distribution of numbers is uniform: for example, the probability of the number being in the range 0.1e0 to 0.2e0 is the same as the probability of its being in the range 0.8e0 to 0.9e0.

The function returned in the permute entry should be such that all permutations of the supplied sequence are equally likely to be chosen.

The map returned by the fn:random-number-generator function may contain additional entries beyond those specified here, but it must match the record type defined above. The meaning of any additional entries is implementation-defined. To avoid conflict with any future version of this specification, the keys of any such entries should start with an underscore character.

Notes

It is not meaningful to ask whether the functions returned in the next and permute functions resulting from two separate calls with the same seed are “the same function”, but the functions must be equivalent in the sense that calling them produces the same sequence of random numbers.

The repeatability of the results of function calls in different execution scopes is outside the scope of this specification. It is recommended that when the same seed is provided explicitly, the same random number sequence should be delivered even in different execution scopes; while if no seed is provided, the processor should choose a seed that is likely to be different from one execution scope to another. (The same effect can be achieved explicitly by using fn:current-dateTime() as a seed.)

The specification does not place strong conformance requirements on the actual randomness of the result; this is left to the implementation. It is desirable, for example, when generating a sequence of random numbers that the sequence should not get into a repeating loop; but the specification does not attempt to dictate this.

Examples

The following example returns a random permutation of the integers in the range 1 to 100:

random-number-generator()?permute(1 to 100)

The following example returns a 10% sample of the items in an input sequence $seq, chosen at random:

random-number-generator()?permute($seq)[1 to (count($seq) idiv 10)]

The following XQuery code produces a random sequence of 200 xs:double values in the range zero to one:

declare %public function local:random-sequence($length as xs:integer) as xs:double* {
  local:random-sequence($length, random-number-generator())
};
declare %private function local:random-sequence(
  $length as xs:integer, 
  $record as record(number as xs:double, next as fn(*), *)
) as xs:double* {
  if ($length != 0) {
    $record?number,
    local:random-sequence($length - 1, $record?next())
  }
};
local:random-sequence(200)

An equivalent result can be achieved with fn:fold-left:

tail(fold-left(
  (1 to 200),
  random-number-generator(),
  fn($result) { head($result) ! (?next(), ?number), tail($result) }
))

5 Processing strings

This section specifies functions and operators on the [XML Schema Part 2: Datatypes Second Edition]xs:string datatype and the datatypes derived from it.

5.3 Comparison of strings

FunctionMeaning
fn:codepoint-equalReturns true if two strings are equal, considered codepoint-by-codepoint.
fn:collationConstructs a collation URI with requested properties.
fn:collation-availableAsks whether a collation URI is recognized by the implementation, and whether it has required properties.
fn:collation-keyGiven a string value and a collation, generates an internal value called a collation key, with the property that the matching and ordering of collation keys reflects the matching and ordering of strings under the specified collation.
fn:contains-tokenDetermines whether or not any of the supplied strings, when tokenized at whitespace boundaries, contains the supplied token, under the rules of the supplied collation.

5.3.11 fn:collation-key

Summary

Given a string value and a collation, generates an internal value called a collation key, with the property that the matching and ordering of collation keys reflects the matching and ordering of strings under the specified collation.

Signature
fn:collation-key(
$valueas xs:string,
$collationas xs:string?:= fn:default-collation()
) as xs:base64Binary
Properties

This function is deterministic, context-dependent, and focus-independent. It depends on collations.

Rules

Calling the one-argument version of this function is equivalent to calling the two-argument version supplying the default collation as the second argument.

The function returns an implementation-dependent value with the property that, for any two strings $K1 and $K2:

  • collation-key($K1, $C) eq collation-key($K2, $C) if and only if compare($K1, $K2, $C) eq 0

  • collation-key($K1, $C) lt collation-key($K2, $C) if and only if compare($K1, $K2, $C) lt 0

The collation used by this function is determined according to the rules in 5.3.7 Choosing a collation. Collation keys are defined as xs:base64Binary values to ensure unambiguous and context-free comparison semantics.

An implementation is free to generate a collation key in any convenient way provided that it always generates the same collation key for two strings that are equal under the collation, and different collation keys for strings that are not equal. This holds only within a single execution scope; an implementation is under no obligation to generate the same collation keys during a subsequent unrelated query or transformation.

It is possible to define collations that do not have the ability to generate collation keys. Supplying such a collation will cause the function to fail. The ability to generate collation keys is an implementation-defined property of the collation.

Error Conditions

An error is raised [err:FOCH0004] if the specified collation does not support the generation of collation keys.

Notes

The function is provided primarily for use with maps. If a map is required where codepoint equality is inappropriate for comparing keys, then a common technique is to normalize the key so that equality matching becomes feasible. There are many ways keys can be normalized, for example by use of functions such as fn:upper-case, fn:lower-case, fn:normalize-space, or fn:normalize-unicode, but this function provides a way of normalizing them according to the rules of a specified collation. For example, if the collation ignores accents, then the function will generate the same collation key for two input strings that differ only in their use of accents.

The result of the function is defined to be an xs:base64Binary value. Binary values are chosen because they have unambiguous and context-free comparison semantics, because the value space is unbounded, and because the ordering rules are such that between any two values in the ordered value space, an arbitrary number of further values can be interpolated. The choice between xs:base64Binary and xs:hexBinary is arbitrary; the only operation that behaves differently between the two binary data types is conversion to/from a string, and this operation is not one that is normally required for effective use of collation keys.

For collations based on the Unicode Collation Algorithm, an algorithm for computing collation keys is provided in [UTS #10]. Implementations are not required to use this algorithm.

The fact that collation keys are ordered can be exploited in XQuery, whose order by clause does not allow the collation to be selected dynamically. This restriction can be circumvented by rewriting the clause order by $e/@key collation "URI" as order by fn:collation-key($e/@key, $collation), where $collation allows the collation to be chosen dynamically.

Note that xs:base64Binary becomes an ordered type in XPath 3.1, making binary collation keys possible.

The fn:collation-available can be used to ask whether a particular collation is capable of delivering collation keys.

Examples
Variables
let $C := collation({ 'strength': 'primary' })
Expression:
map:merge(
  ({ collation-key("A", $C): 1 }, { collation-key("a", $C): 2 }),
  { "duplicates": "use-last" }
)(collation-key("A", $C))
Result:
2

(Given that the keys of the two entries are equal under the rules of the chosen collation, only one of the entries can appear in the result; the one that is chosen is the one from the last map in the input sequence.)

Expression:
let $M := {
  collation-key("A", $C): 1,
  collation-key("B", $C): 2
}
return $M(collation-key("a", $C))
Result:
1

(The strings "A" and "a" have the same collation key under this collation.)

As the above examples illustrate, it is important that when the collation-key function is used to add entries to a map, then it must also be used when retrieving entries from the map. This process can be made less error-prone by encapsulating the map within a function: fn($k) { $M(collation-key($k, $collation) }.

5.3.12 fn:contains-token

Summary

Determines whether or not any of the supplied strings, when tokenized at whitespace boundaries, contains the supplied token, under the rules of the supplied collation.

Signature
fn:contains-token(
$valueas xs:string*,
$tokenas xs:string,
$collationas xs:string?:= fn:default-collation()
) as xs:boolean
Properties

The two-argument form of this function is deterministic, context-dependent, and focus-independent. It depends on collations.

The three-argument form of this function is deterministic, context-dependent, and focus-independent. It depends on collations, and static base URI.

Rules

If $value is the empty sequence, the function returns false.

Leading and trailing whitespace is trimmed from $token. If the trimmed value of $token is a zero-length string, the function returns false.

The collation used by this function is determined according to the rules in 5.3.7 Choosing a collation.

The function returns true if and only if there is string in $value which, after tokenizing at whitespace boundaries, contains a token that is equal to the trimmed value of $token under the rules of the selected collation.

Formal Equivalent

The effect of the function is equivalent to the result of the following XPath expression.

some $t in ($value ! tokenize(.))
satisfies compare($t, replace($token, '^\s*|\s*$', ''), $collation) eq 0
Notes

Interior whitespace within $token will cause the function to return false, unless such whitespace is ignored by the selected collation.

This function can be used for processing space-separated attribute values (for example, the XHTML and DITA class attribute), where one often needs to test for the presence of a single token in a space-separated list. The function is designed to work both when the attribute has been validated against an XSD list type, and when it appears as a single untyped string. It differs from the HTML 5 definition in that HTML 5 recognizes form feed (x0C) as a separator. To reproduce the HTML token matching behavior, the HTML ASCII case-insensitive collation should be used: see 5.3.6 The HTML ASCII Case-Insensitive Collation.

Examples
Expression:

contains-token("red green blue ", "red")

Result:

true()

Expression:

contains-token(("red", "green", "blue"), " red ")

Result:

true()

Expression:

contains-token("red, green, blue", "red")

Result:

false()

Expression:
contains-token(
  "red green blue",
  "RED",
  "http://www.w3.org/2005/xpath-functions/collation/html-ascii-case-insensitive"
)
Result:
true()

5.4 Functions on string values

The following functions are defined on values of type xs:string and types derived from it.

FunctionMeaning
fn:charReturns a string containing a particular character or glyph.
fn:charactersSplits the supplied string into a sequence of single-character strings.
fn:graphemesSplits the supplied string into a sequence of single-grapheme strings.
fn:concatReturns the concatenation of the arguments, treated as sequences of strings.
fn:string-joinReturns a string created by concatenating the items in a sequence, with a defined separator between adjacent items.
fn:substringReturns the part of $value beginning at the position indicated by $start and continuing for the number of characters indicated by $length.
fn:string-lengthReturns the number of characters in a string.
fn:normalize-spaceReturns $value with leading and trailing whitespace removed, and sequences of internal whitespace reduced to a single space character.
fn:normalize-unicodeReturns $value after applying Unicode normalization.
fn:upper-caseConverts a string to upper case.
fn:lower-caseConverts a string to lower case.
fn:translateReturns $value modified by replacing or removing individual characters.
fn:hashReturns the results of a specified hash, checksum, or cyclic redundancy check function applied to the input.

Notes:

When the above operators and functions are applied to datatypes derived from xs:string, they are guaranteed to return values that are instances of xs:string, but the value might or might not be an instance of the particular subtype of xs:string to which they were applied.

The strings returned by fn:concat and fn:string-join are not guaranteed to be normalized. But see note in fn:concat.

5.4.5 fn:string-join

Summary

Returns a string created by concatenating the items in a sequence, with a defined separator between adjacent items.

Signature
fn:string-join(
$valuesas xs:anyAtomicType*,
$separatoras xs:string?:= ""
) as xs:string
Properties

This function is deterministic, context-independent, and focus-independent.

Rules

If the second argument is omitted or an empty sequence, the effect is the same as calling the two-argument version with $separator set to a zero-length string.

The coercion rules ensure that the supplied $values argument is first converted to a sequence of atomic items by applying atomization.

The function then returns an xs:string created by casting each item in the atomized sequence to an xs:string, and then concatenating the result strings in order, using the value of $separator as a separator between adjacent strings. If $separator is the zero-length string, then the items in $values are concatenated without a separator.

Notes

If $values is the empty sequence, the function returns the zero-length string.

Examples
Variables
let $doc := <doc><chap><section xml:id="xyz"/></chap></doc>
Expression:

string-join(1 to 9)

Result:

"123456789"

Expression:

string-join(('Now', 'is', 'the', 'time', '...'), ' ')

Result:

"Now is the time ..."

Expression:
string-join(
  ('Blow, ', 'blow, ', 'thou ', 'winter ', 'wind!'),
  ''
)
Result:
"Blow, blow, thou winter wind!"
Expression:

string-join((), 'separator')

Result:

""

Expression:

string-join(1 to 5, ', ')

Result:

"1, 2, 3, 4, 5"

Expression:
$doc//@xml:id
! string-join((node-name(), '="', ., '"'))
Result:
'xml:id="xyz"'
Expression:
$doc//section
! string-join(ancestor-or-self::*/name(), '/')
Result:
"doc/chap/section"

5.4.6 fn:substring

Changes in 4.0 (next | previous)

  1. The third argument can now be supplied as an empty sequence.  [Issue 895 PR 901 16 December 2023]

Summary

Returns the part of $value beginning at the position indicated by $start and continuing for the number of characters indicated by $length.

Signature
fn:substring(
$valueas xs:string?,
$startas xs:double,
$lengthas xs:double?:= ()
) as xs:string
Properties

This function is deterministic, context-independent, and focus-independent.

Rules

If $value is the empty sequence, the function returns the zero-length string.

Otherwise, the function returns a string comprising those characters of $value whose index position (counting from one) is greater than or equal to $start (rounded to an integer), and (if $length is specified and non-empty) less than the sum of $start and $length (both rounded to integers).

The characters returned do not extend beyond $value. If $start is zero or negative, only those characters in positions greater than zero are returned.

More specifically, the three argument version of the function returns the characters in $value whose position $p satisfies:

fn:round($start) <= $p and $p < fn:round($start) + fn:round($length)

The two argument version of the function assumes that $length is infinite and thus returns the characters in $value whose position $p satisfies:

fn:round($start) <= $p

In the above computations, the operators such as <= and + are evaluated according to the rules of the XPath 4.0 specification.

Notes

The first character of a string is located at position 1, not position 0.

The second and third arguments allow xs:double values (rather than requiring xs:integer) in order to achieve compatibility with XPath 1.0.

A surrogate pair counts as one character, not two.

The consequences of supplying values such as NaN or positive or negative infinity for the $start or $length arguments follow from the above rules, and are not always intuitive.

Examples
ExpressionResult
substring("motor car", 6)

" car"

(Characters starting at position 6 to the end of $sourceString are selected.)

substring("metadata", 4, 3)

"ada"

(Characters at positions greater than or equal to 4 and less than 7 are selected.)

substring("12345", 1.5, 2.6)

"234"

(Characters at positions greater than or equal to 2 and less than 5 are selected.)

substring("12345", 0, 3)

"12"

(Characters at positions greater than or equal to 0 and less than 3 are selected. Since the first position is 1, these are the characters at positions 1 and 2.)

substring("12345", 5, -3)

""

(Characters at positions greater than or equal to 5 and less than 2 are selected.)

substring("12345", -3, 5)

"1"

(Characters at positions greater than or equal to -3 and less than 2 are selected. Since the first position is 1, this is the character at position 1.)

substring("12345", 0 div 0E0, 3)

""

(Since 0 div 0E0 returns NaN, and NaN compared to any other number returns false, no characters are selected.)

substring("12345", 1, 0 div 0E0)

""

(As above.)

substring((), 1, 3)

""

substring("12345", -42, 1 div 0E0)

"12345"

(Characters at positions greater than or equal to -42 and less than INF are selected.)

substring("12345", -1 div 0E0, 1 div 0E0)

""

(Since the value of -INF + INF is NaN, no characters are selected.)

5.4.7 fn:string-length

Changes in 4.0 (next | previous)

  1. The type of $value has been generalized to xs:anyAtomicType?.  [Issue 2279 PR 2286 17 November 2025]

Summary

Returns the number of characters in a string.

Signature
fn:string-length(
$valueas xs:anyAtomicType?:= fn:string(.)
) as xs:integer
Properties

The zero-argument form of this function is deterministic, context-dependent, and focus-dependent.

The one-argument form of this function is deterministic, context-independent, and focus-independent.

Rules

If the argument is omitted, it defaults to fn:string(.).

If the value is the empty sequence, the function returns the xs:integer value 0. Otherwise, the value is cast to an xs:string, and an xs:integer is returned that reflects the number of characters in the string.

Error Conditions

If $value is not specified and the context value is absentDM, a type error is raised: [err:XPDY0002]XP.

As a consequence of the rules given above, a type error is raised [err:XPTY0004]XP if the context value cannot be atomized, or if the result of atomizing the context value is a sequence containing more than one atomic item.

Notes

Unlike some programming languages, a codepoint greater than 65535 counts as one character, not two.

There are situations where fn:string-length() has a different effect from fn:string-length(.). These situations all involve nodes with non-trivial type annotations. For example:

  • If the context value is an attribute node typed as an xs:integer with the string value 000001, then fn:string-length() returns 6 (the length of the string value of the node), while fn:string-length(.) returns 1 (the length of the string that results from converting the typed value (1) to a string). In earlier versions of this specification this call would have failed with a type error.

  • If the context value is the element node <e> NN </e>, and has the type annotation xs:NCName, then fn:string-length() returns 4 (the length of the string value of the element node), while fn:string-length(.) returns 2 (the length of the typed value of the element node).

  • If the context value is the attribute node ref="A B C", and has the type annotation xs:IDREFS, then fn:string-length() returns 5 (the length of the string value of the attribute node), while fn:string-length(.) raises an error, because the atomized value of the attribute is a sequence of strings, and calling the fn:string function on a sequence of strings fails.

Examples
Expression:
string-length(
  "As long as a piece of string"
)
Result:
28
Expression:
"ᾧ" => string-length()
Result:
1
Expression:
"ᾧ" => normalize-unicode("NFD") => string-length()
Result:
4

(For strings that consist of a base character with combining characters, each combining character is length 1.)

Expression:

string-length(())

Result:

0

5.4.8 fn:normalize-space

Changes in 4.0 (next | previous)

  1. The type of $value has been generalized to xs:anyAtomicType?.  [Issue 2279 PR 2286 17 November 2025]

Summary

Returns $value with leading and trailing whitespace removed, and sequences of internal whitespace reduced to a single space character.

Signature
fn:normalize-space(
$valueas xs:anyAtomicType?:= string(.)
) as xs:string
Properties

The zero-argument form of this function is deterministic, context-dependent, and focus-dependent.

The one-argument form of this function is deterministic, context-independent, and focus-independent.

Rules

If the argument is omitted, it defaults to fn:string(.).

If the value is the empty sequence, the function returns a zero-length string. Otherwise, the value is cast to an xs:string, and a new string is constructed by stripping leading and trailing whitespace from the string, and by replacing sequences of one or more adjacent whitespace characters with a single space, U+0020 (SPACE) .

The whitespace characters are defined in the metasymbol S (Production 3) of [Extensible Markup Language (XML) 1.0 (Fifth Edition)].

Error Conditions

If no argument is supplied and the context value is absentDM, a type error is raised [err:XPDY0002]XP.

As a consequence of the rules given above, a type error is raised [err:XPTY0004]XP if the context value cannot be atomized, or if the result of atomizing the context value is a sequence containing more than one atomic item.

Notes

The definition of whitespace is unchanged in [Extensible Markup Language (XML) 1.1 Recommendation]. It is repeated here for convenience:

S ::= (#x20 | #x9 | #xD | #xA)+

There are situations where fn:normalize-space() has a different effect from fn:normalize-space(.). These situations all involve nodes with non-trivial type annotations. For example:

  • If the context value is an attribute node typed as an xs:integer with the string value 000001, then fn:normalize-space() returns "000001" (the string value of the node, whitespace-normalized), while fn:normalize-space(.) returns "1" (the typed value of the node, converted to a string and then normalized).

  • If the context value is the attribute node ref=" A B C ", and has the type annotation xs:IDREFS, then fn:normalize-space() returns "A B C" (the string value of the attribute node, whitespace-normalized), while fn:normalize-space(.) raises an error, because the typed value of the attribute is a sequence of strings, and calling the fn:string function on a sequence of strings fails.

The effect of fn:normalize-space is exactly the same as the effect of the whitespace=collapse facet in XSD. Since this facet is implicit for most XSD data types (with the notable exception of xs:string itself), nodes that are validated against types other than xs:string will tend to be implicitly in the form that normalize-string generates. Confusingly, the XSD type xs:normalizedString uses the facet whitespace=replace, which does not have the same effect as the normalize-space function: it replaces all whitespace characters by U+0020 (SPACE) , but does not remove leading or trailing spaces, nor does it merge adjacent spaces.

Examples
Expression:
normalize-space(" The    wealthy curled darlings
           of    our    nation. ")
Result:
"The wealthy curled darlings of our nation."
Expression:

normalize-space(())

Result:

""

5.4.9 fn:normalize-unicode

Summary

Returns $value after applying Unicode normalization.

Signature
fn:normalize-unicode(
$valueas xs:string?,
$formas xs:string?:= "NFC"
) as xs:string
Properties

This function is deterministic, context-independent, and focus-independent.

Rules

If $value is the empty sequence, the function returns the zero-length string.

If the second argument is omitted or an empty sequence, the result is the same as calling the two-argument version with $form set to the string "NFC".

Otherwise, the function returns $value normalized according to the rules of the normalization form identified by the value of $form.

The effective value of $form is the value of the expression fn:upper-case(fn:normalize-space($form)).

  • If the effective value of $form is “NFC”, then the function returns $value converted to Unicode Normalization Form C (NFC).

  • If the effective value of $form is “NFD”, then the function returns $value converted to Unicode Normalization Form D (NFD).

  • If the effective value of $form is “NFKC”, then the function returns $value in Unicode Normalization Form KC (NFKC).

  • If the effective value of $form is “NFKD”, then the function returns $value converted to Unicode Normalization Form KD (NFKD).

  • If the effective value of $form is “FULLY-NORMALIZED”, then the function returns $value converted to fully normalized form.

  • If the effective value of $form is the zero-length string, no normalization is performed and $value is returned.

Normalization forms NFC, NFD, NFKC, and NFKD, and the algorithms to be used for converting a string to each of these forms, are defined in [UAX #15].

The motivation for normalization form FULLY-NORMALIZED is explained in [Character Model for the World Wide Web 1.0: Normalization]. However, as that specification did not progress beyond working draft status, the normative specification is as follows:

  • A string is fully-normalized if (a) it is in normalization form NFC as defined in [UAX #15], and (b) it does not start with a composing character.

  • A composing character is a character that is one or both of the following:

    • the second character in the canonical decomposition mapping of some character that is not listed in the Composition Exclusion Table defined in [UAX #15];

    • of non-zero canonical combining class (as defined in [The Unicode Standard]).

  • A string is converted to FULLY-NORMALIZED form as follows:

    • if the first character in the string is a composing character, prepend a single space (x20);

    • convert the resulting string to normalization form NFC.

Conforming implementations must support normalization form NFC and may support normalization forms NFD, NFKC, NFKD, and FULLY-NORMALIZED. They may also support other normalization forms with implementation-defined semantics.

It is implementation-defined which version of Unicode (and therefore, of the normalization algorithms and their underlying data) is supported by the implementation. See [UAX #15] for details of the stability policy regarding changes to the normalization rules in future versions of Unicode. If the input string contains codepoints that are unassigned in the relevant version of Unicode, or for which no normalization rules are defined, the fn:normalize-unicode function leaves such codepoints unchanged. If the implementation supports the requested normalization form then it must be able to handle every input string without raising an error.

Error Conditions

A dynamic error is raised [err:FOCH0003] if the effective value of the $form argument is not one of the values supported by the implementation.

5.4.13 fn:hash

Changes in 4.0 (next | previous)

  1. New in 4.0  [Issues 779 1188 1422 1426 PRs 937 995 1190 23 January 2024]

Summary

Returns the results of a specified hash, checksum, or cyclic redundancy check function applied to the input.

Signature
fn:hash(
$valueas (xs:string | xs:hexBinary | xs:base64Binary)?,
$algorithmas xs:string?:= "MD5",
$optionsas map(*)?:= {}
) as xs:hexBinary?
Properties

This function is deterministic, context-independent, and focus-independent.

Rules

If $value is the empty sequence, the function returns the empty sequence.

If $value is an instance of xs:string, it is converted to a sequence of octets on the basis of UTF-8 encoding. If $value is an instance of xs:base64Binary or xs:hexBinary, it is converted to a sequence of octets.

The $algorithm argument, if present, determines the algorithm to be used to calculate a checksum, hash, or cyclic redundancy check. If empty or absent, MD5 will be used. The effective value of the algorithm is determined by passing the value through fn:upper-case(fn:normalize-space()).

Conforming implementations must support the following options and the functions referred to by them:

  • MD5: the MD5 Message-Digest algorithm, defined by [RFC 6151] (update to [RFC 1321]).

  • SHA-1: the SHA-1 algorithm, defined by [FIPS 180-4].

  • SHA-256: the SHA-256 algorithm, defined by [FIPS 180-4].

  • BLAKE3: the BLAKE3 algorithm defined by [BLAKE3 Hashing].

  • CRC-32: the CRC-32 algorithm, defined by [IEEE 802-3]. It delivers a 32 bit unsigned integer, which this function returns as a 4-octet xs:hexBinary value representing this integer in big-endian order (that is, most significant byte first).

    Note:

    Some libraries, notably System.IO.Hashing.Crc32 in .NET, return the result in little-endian order.

Conforming implementations may support other checksum and hash functions with implementation-defined semantics. The $options argument, if present, defines additional parameters controlling how the process is conducted.

The function returns as xs:hexBinary the octets returned by passing $value as an octet sequence through the selected algorithm. The process is followed even if the input octet sequence is empty.

Error Conditions

A dynamic error is raised [err:FOHA0001] if the effective value of the option algorithm is not one of the values supported by the implementation.

Notes

It is common for secure algorithms to be cryptographically broken, as has happened to the algorithms MD5, SHA-1, and SHA-256. And the CRC-32 algorithm is not intended for cryptographic purposes. Developers are responsible for ensuring that the algorithm chosen meets any expected security protocols, if relevant.

The BLAKE3 algorithm is included in the list of hashing algorithms because at the time of writing it appears to be a promising candidate as a secure and fast algorithm that shows signs of gaining widespread support. However, this is a fast moving field and the community group recognizes that this decision might eventually not stand the test of time. As the technology evolves in the future, implementations are free to drop support for this algorithm and substitute another that appears to better meet requirements.

Additional security practices, such as salting, may be applied as a preprocessing step, or fn:hash() can be incorporated into more complex functions.

In most cases, the xs:hexBinary output of the function will be sought in string form. Because of serialization rules, casting to a string renders the hash in uppercase, and rendering in lowercase (as adopted by [RFC 1321] and [FIPS 180-4]) requires further adjustment.

Examples
Variables
let $doc := <doc>abc</doc>
let $salt := "D;%yL9TS:5PalS/d"
Expression:
hash("abc")
Result:
xs:hexBinary("900150983CD24FB0D6963F7D28E17F72")
Expression:
hash("ABC")
Result:
xs:hexBinary("902FBDD2B1DF0C4F70B4A5D23525E932")
Expression:
hash("")
Result:
xs:hexBinary("D41D8CD98F00B204E9800998ECF8427E")
Expression:
hash("ABC", "SHA-1")
Result:
xs:hexBinary("3C01BDBB26F358BAB27F267924AA2C9A03FCFDB8")
Expression:
hash("ABC", "BLAKE3") 
=> string()
=> lower-case()
Result:
"d1717274597cf0289694f75d96d444b992a096f1afd8e7bbfa6ebb1d360fedfc"
Expression:
hash("ABC", "BLAKE3") 
=> xs:base64Binary()
=> string()
Result:
"0XFydFl88CiWlPddltREuZKglvGv2Oe7+m67HTYP7fw="
Expression:
hash("ABC", "sha-256")
=> string()
Result:
"B5D4045C3F466FA91FE2CC6ABE79232A1A57CDF104F7A26E716E0A1E2789DF78"
Expression:
hash("ABC", "sha-256")
Result:
xs:hexBinary("B5D4045C3F466FA91FE2CC6ABE79232A1A57CDF104F7A26E716E0A1E2789DF78")
Expression:
hash($doc)
Result:
xs:hexBinary("900150983CD24FB0D6963F7D28E17F72")
Expression:
hash(serialize($doc), "sha-1") 
=> xs:base64Binary()   
=> string()
Result:
"8PzN28NtxQv5RlxQ5/w6DcnrpEU="
Expression:
hash("password123" || $salt, "SHA-256")
Result:
xs:hexBinary("9C9B913EB1B6254F4737CE947EFD16F16E916F9D6EE5C1102A2002E48D4C88BD")
Expression:
hash("", "CRC-32")
Result:
xs:hexBinary("00000000")
Expression:
hash("input", "CRC-32")
Result:
xs:hexBinary("D82832D7")
Expression:

hash("password123", "sha-unknown")

Result:

Raises error FOHA0001.

5.5 Functions based on substring matching

The functions described in this section examine a string $arg1 to see whether it contains another string $arg2 as a substring. The result depends on whether $arg2 is a substring of $arg1, and if so, on the range of characters in $arg1 which $arg2 matches.

When the Unicode codepoint collation is used, this simply involves determining whether $arg1 contains a contiguous sequence of characters whose codepoints are the same, one for one, with the codepoints of the characters in $arg2.

When a collation is specified, the rules are more complex.

All collations support the capability of deciding whether two strings are considered equal, and if not, which of the strings should be regarded as preceding the other. For functions such as fn:compare, this is all that is required. For other functions, such as fn:contains, the collation needs to support an additional property: it must be able to decompose the string into a sequence of collation units, each unit consisting of one or more characters, such that two strings can be compared by pairwise comparison of these units.

[Definition] The term collation unit as used in this specification is equivalent to the term collation element used in [UTS #10].

The string Q is then considered to contain P as a substring if the sequence of collation units corresponding to P is a subsequence of the sequence of collation units corresponding to Q. The characters in P that match are the characters corresponding to these collation units.

This rule may occasionally lead to surprises. For example, consider a collation that treats "Jaeger" and "Jäger" as equal. It might do this by treating "ä" as representing two collation units, in which case the expression fn:contains("Jäger", "eg") will return true. Alternatively, a collation might treat "ae" as a single collation unit, in which case the expression fn:contains("Jaeger", "eg") will return false. The results of these functions thus depend strongly on the properties of the collation that is used.

In addition, collations may specify that some collation units should be ignored during matching. If hyphen is an ignored collation unit, then fn:contains("code-point", "codepoint") will be true, and fn:contains("codepoint", "-") will also be true.

In the rules for the functions defined in this section, we use the following terms taken from [UTS #10]:

  • [Definition] The term match is used in the sense of definition DS2 from [UTS #10].

  • [Definition] The term minimal match is used in the sense of definition DS4 from [UTS #10].

In the definitions in [UTS #10], these rules involve a number of parameters. In the context of the functions defined in this section, these parameters are interpreted as follows:

  • C is the collation; that is, the value of the $collation argument if specified, otherwise the default collation.

  • P is the (candidate) substring, the value of the $substring argument to the function.

  • Q is the (candidate) containing string, the value of the $value argument to the function.

  • The boundary condition B is satisfied at the start and end of a string, and between any two characters that belong to different collation units (“collation elements” in the language of [UTS #10]). It is not satisfied between two characters that belong to the same collation unit.

It is possible to define collations that do not have the ability to decompose a string into units suitable for substring matching. An argument to a function defined in this section may be a URI that identifies a collation that is able to compare two strings, but that does not have the capability to split the string into collation units. Such a collation may cause the function to fail, or to give unexpected results, or it may be rejected as an unsuitable argument. The ability to decompose strings into collation units is an implementation-defined property of the collation. The fn:collation-available function can be used to ask whether a particular collation has this property.

FunctionMeaning
fn:containsReturns true if the string $value contains $substring as a substring, taking collations into account.
fn:starts-withReturns true if the string $value contains $substring as a leading substring, taking collations into account.
fn:ends-withReturns true if the string $value contains $substring as a trailing substring, taking collations into account.
fn:substring-beforeReturns the part of $value that precedes the first occurrence of $substring, taking collations into account.
fn:substring-afterReturns the part of $value that follows the first occurrence of $substring, taking collations into account.

5.5.1 fn:contains

Summary

Returns true if the string $value contains $substring as a substring, taking collations into account.

Signature
fn:contains(
$valueas xs:string?,
$substringas xs:string?,
$collationas xs:string?:= fn:default-collation()
) as xs:boolean
Properties

The two-argument form of this function is deterministic, context-dependent, and focus-independent. It depends on collations.

The three-argument form of this function is deterministic, context-dependent, and focus-independent. It depends on collations, and static base URI.

Rules

If $value or $substring is the empty sequence, or contains only ignorable collation units, it is interpreted as the zero-length string.

If $substring is the zero-length string, then the function returns true.

If $value is the zero-length string, the function returns false.

The collation used by this function is determined according to the rules in 5.3.7 Choosing a collation.

The function returns an xs:boolean indicating whether or not $value contains (at the beginning, at the end, or anywhere within) at least one sequence of collation units that provides a minimal match to the collation units in $substring, according to the collation that is used.

Error Conditions

A dynamic error may be raised [err:FOCH0004] if the specified collation does not support collation units.

Examples
Variables
let $coll := 
"http://www.w3.org/2013/collation/UCA?lang=en;alternate=blanked;strength=primary"
ExpressionResult

The collation used in some of these examples, $coll, is a collation in which both - and * are ignorable collation units.

“Ignorable collation unit” is equivalent to “ignorable collation element” in [UTS #10].

contains("tattoo", "t")

true()

contains("tattoo", "ttt")

false()

contains("", ())

true()

(The first rule is applied, followed by the second rule.)

contains(
  "abcdefghi",
  "-d-e-f-",
  $coll
)
true()
contains(
  "a*b*c*d*e*f*g*h*i*",
  "d-ef-",
  $coll
)
true()
contains(
  "abcd***e---f*--*ghi",
  "def",
  $coll
)
true()
contains(
  (),
  "--***-*---",
  $coll
)
true()

(The second argument contains only ignorable collation units and is equivalent to the zero-length string.)

5.5.2 fn:starts-with

Summary

Returns true if the string $value contains $substring as a leading substring, taking collations into account.

Signature
fn:starts-with(
$valueas xs:string?,
$substringas xs:string?,
$collationas xs:string?:= fn:default-collation()
) as xs:boolean
Properties

The two-argument form of this function is deterministic, context-dependent, and focus-independent. It depends on collations.

The three-argument form of this function is deterministic, context-dependent, and focus-independent. It depends on collations, and static base URI.

Rules

If $value or $substring is the empty sequence, or contains only ignorable collation units, it is interpreted as the zero-length string.

If $substring is the zero-length string, then the function returns true. If $value is the zero-length string and $substring is not the zero-length string, then the function returns false.

The collation used by this function is determined according to the rules in 5.3.7 Choosing a collation.

The function returns an xs:boolean indicating whether or not $value starts with a sequence of collation units that provides a match to the collation units of $substring according to the collation that is used.

Error Conditions

A dynamic error may be raised [err:FOCH0004] if the specified collation does not support collation units.

Examples
Variables
let $coll := 
"http://www.w3.org/2013/collation/UCA?lang=en;alternate=blanked;strength=primary"
ExpressionResult

The collation used in some of these examples, $coll, is a collation in which both - and * are ignorable collation units.

“Ignorable collation unit” is equivalent to “ignorable collation element” in [UTS #10].

starts-with("tattoo", "tat")

true()

starts-with("tattoo", "att")

false()

starts-with((), ())

true()

starts-with(
  "abcdefghi",
  "-a-b-c-",
  $coll
)
true()
starts-with(
  "a*b*c*d*e*f*g*h*i*",
  "a-bc-",
  $coll
)
true()
starts-with(
  "abcd***e---f*--*ghi",
  "abcdef",
  $coll
)
true()
starts-with(
  (),
  "--***-*---",
  $coll
)
true()

(The second argument contains only ignorable collation units and is equivalent to the zero-length string.)

starts-with(
  "-abcdefghi",
  "-abc",
  $coll
)
true()

5.5.3 fn:ends-with

Summary

Returns true if the string $value contains $substring as a trailing substring, taking collations into account.

Signature
fn:ends-with(
$valueas xs:string?,
$substringas xs:string?,
$collationas xs:string?:= fn:default-collation()
) as xs:boolean
Properties

The two-argument form of this function is deterministic, context-dependent, and focus-independent. It depends on collations.

The three-argument form of this function is deterministic, context-dependent, and focus-independent. It depends on collations, and static base URI.

Rules

If $value or $substring is the empty sequence, or contains only ignorable collation units, it is interpreted as the zero-length string.

If $substring is the zero-length string, then the function returns true. If $value is the zero-length string and the value of $substring is not the zero-length string, then the function returns false.

The collation used by this function is determined according to the rules in 5.3.7 Choosing a collation.

The function returns an xs:boolean indicating whether or not $value ends with a sequence of collation units that provides a match to the collation units of $substring according to the collation that is used.

Error Conditions

A dynamic error may be raised [err:FOCH0004] if the specified collation does not support collation units.

Examples
Variables
let $coll := 
"http://www.w3.org/2013/collation/UCA?lang=en;alternate=blanked;strength=primary"
ExpressionResult

The collation used in some of these examples, $coll, is a collation in which both - and * are ignorable collation units.

“Ignorable collation unit” is equivalent to “ignorable collation element” in [UTS #10].

ends-with("tattoo", "tattoo")

true()

ends-with("tattoo", "atto")

false()

ends-with((), ())

true()

ends-with(
  "abcdefghi",
  "-g-h-i-",
  $coll
)
true()
ends-with(
  "abcd***e---f*--*ghi",
  "defghi",
  $coll
)
true()
ends-with(
  "abcd***e---f*--*ghi",
  "defghi",
  $coll
)
true()
ends-with(
  (),
  "--***-*---",
  $coll
)
true()

(The second argument contains only ignorable collation units and is equivalent to the zero-length string.)

ends-with(
  "abcdefghi",
  "ghi-",
  $coll
)
true()

5.5.4 fn:substring-before

Summary

Returns the part of $value that precedes the first occurrence of $substring, taking collations into account.

Signature
fn:substring-before(
$valueas xs:string?,
$substringas xs:string?,
$collationas xs:string?:= fn:default-collation()
) as xs:string
Properties

The two-argument form of this function is deterministic, context-dependent, and focus-independent. It depends on collations.

The three-argument form of this function is deterministic, context-dependent, and focus-independent. It depends on collations, and static base URI.

Rules

If $value or $substring is the empty sequence, or contains only ignorable collation units, it is interpreted as the zero-length string.

If $substring is the zero-length string, then the function returns the zero-length string.

If $value does not contain a string that is equal to $substring, then the function returns the zero-length string.

The collation used by this function is determined according to the rules in 5.3.7 Choosing a collation.

The function returns the substring of $value that precedes in $value the first occurrence of a sequence of collation units that provides a minimal match to the collation units of $substring according to the collation that is used.

Error Conditions

A dynamic error may be raised [err:FOCH0004] if the specified collation does not support collation units.

Examples
Variables
let $coll := 
"http://www.w3.org/2013/collation/UCA?lang=en;alternate=blanked;strength=primary"
ExpressionResult

The collation used in some of these examples, $coll, is a collation in which both - and * are ignorable collation units.

“Ignorable collation unit” is equivalent to “ignorable collation element” in [UTS #10].

substring-before("tattoo", "attoo")

"t"

substring-before("tattoo", "tatto")

""

substring-before((), ())

""

substring-before(
  "abcdefghi",
  "--d-e-",
  $coll
)
"abc"
substring-before(
  "abc--d-e-fghi",
  "--d-e-",
  $coll
)
"abc--"
substring-before(
  "a*b*c*d*e*f*g*h*i*",
  "***cde",
  $coll
)
"a*b*"
substring-before(
  "Eureka!",
  "--***-*---",
  $coll
)
""

(The second argument contains only ignorable collation units and is equivalent to the zero-length string.)

5.5.5 fn:substring-after

Summary

Returns the part of $value that follows the first occurrence of $substring, taking collations into account.

Signature
fn:substring-after(
$valueas xs:string?,
$substringas xs:string?,
$collationas xs:string?:= fn:default-collation()
) as xs:string
Properties

The two-argument form of this function is deterministic, context-dependent, and focus-independent. It depends on collations.

The three-argument form of this function is deterministic, context-dependent, and focus-independent. It depends on collations, and static base URI.

Rules

If $value or $substring is the empty sequence, or contains only ignorable collation units, it is interpreted as the zero-length string.

If $substring is the zero-length string, then the function returns the value of $value.

If $value does not contain a string that is equal to $substring, then the function returns the zero-length string.

The collation used by this function is determined according to the rules in 5.3.7 Choosing a collation.

The function returns the substring of $value that follows in $value the first occurrence of a sequence of collation units that provides a minimal match to the collation units of $substring according to the collation that is used.

Error Conditions

A dynamic error may be raised [err:FOCH0004] if the specified collation does not support collation units.

Examples
Variables
let $coll := 
"http://www.w3.org/2013/collation/UCA?lang=en;alternate=blanked;strength=primary"
ExpressionResult

The collation used in some of these examples, $coll, is a collation in which both - and * are ignorable collation units.

“Ignorable collation unit” is equivalent to “ignorable collation element” in [UTS #10].

substring-after("tattoo", "tat")

"too"

substring-after("tattoo", "tattoo")

""

substring-after((), ())

""

substring-after(
  "abcdefghi",
  "--d-e-",
  $coll
)
"fghi"
substring-after(
  "abc--d-e-fghi",
  "--d-e-",
  $coll
)
"-fghi"
substring-after(
  "a*b*c*d*e*f*g*h*i*",
  "***cde***",
  $coll
)
"*f*g*h*i*"
substring-after(
  "Eureka!",
  "--***-*---",
  $coll
)
"Eureka!"

(The second argument contains only ignorable collation units and is equivalent to the zero-length string.)

6 Regular expressions

The functions described in this section make use of a regular expression syntax for pattern matching. The syntax and semantics of regular expressions are defined in this section.

6.3 Functions using regular expressions

FunctionMeaning
fn:matchesReturns true if the supplied string matches a given regular expression.
fn:replaceReturns a string produced from the input string by replacing any segments that match a given regular expression with a supplied replacement string, provided either literally, or by invoking a supplied function.
fn:tokenizeReturns a sequence of strings constructed by splitting the input wherever a separator is found; the separator is any substring that matches a given regular expression.
fn:analyze-stringAnalyzes a string using a regular expression, returning an XML structure that identifies which parts of the input string matched or failed to match the regular expression, and in the case of matched substrings, which substrings matched each capturing group in the regular expression.

6.3.1 fn:matches

Summary

Returns true if the supplied string matches a given regular expression.

Signature
fn:matches(
$valueas xs:string?,
$patternas xs:string,
$flagsas xs:string?:= ""
) as xs:boolean
Properties

This function is deterministic, context-independent, and focus-independent.

Rules

If $value is the empty sequence, it is interpreted as the zero-length string.

If the $flags argument is omitted or if it is an empty sequence, the effect is the same as setting $flags to a zero-length string. Flags are defined in 6.2 Flags.

The function returns true if the set of disjoint matching segments obtained by matching $value against the regular expression $pattern, with the associated $flags, is non-empty. Otherwise, the function returns false.

Error Conditions

A dynamic error is raised [err:FORX0002] if $pattern is invalid according to the rules described in 6.1 Regular expression syntax.

A dynamic error is raised [err:FORX0001] if $flags is invalid according to the rules described in 6.2 Flags.

Notes

Unless the metacharacters ^ and $ are used as anchors, the string is considered to match the pattern if any substring matches the pattern. But if anchors are used, the anchors must match the start/end of the string (in string mode), or the start/end of a line (in multi-line mode).

This is different from the behavior of patterns in [XML Schema Part 2: Datatypes Second Edition], where regular expressions are implicitly anchored.

Regular expression matching is defined on the basis of Unicode codepoints; it takes no account of collations.

It is valid for the regular expression to match a zero-length segment of $value. For example, the result of the expression matches($s, "") is always true, regardless of the value of $s.

Examples
Variables
let $poem := <poem author="Wilhelm Busch">
Kaum hat dies der Hahn gesehen,
Fängt er auch schon an zu krähen:
Kikeriki! Kikikerikih!!
Tak, tak, tak! - da kommen sie.
</poem>
ExpressionResult
matches("abracadabra", "bra")

true()

matches("abracadabra", "^a.*a$")

true()

matches("abracadabra", "^bra")

false()

matches($poem, "Kaum.*krähen")

false()

matches($poem, "Kaum.*krähen", "s")

true()

matches($poem, "^Kaum.*gesehen,$", "m")

true()

matches($poem, "^Kaum.*gesehen,$")

false()

matches($poem, "kiki", "i")

true()

6.3.2 fn:replace

Changes in 4.0 (next | previous)

  1. The $replacement argument can now be a function that computes the replacement strings.  [Issue 1876 PR 1897 8 April 2025]

  2. It is now permitted for the regular expression to match a zero-length string.  [ PR 1856]

Summary

Returns a string produced from the input string by replacing any segments that match a given regular expression with a supplied replacement string, provided either literally, or by invoking a supplied function.

Signature
fn:replace(
$valueas xs:string?,
$patternas xs:string,
$replacementas (xs:string | fn(xs:untypedAtomic, xs:untypedAtomic*) as item()?)?:= ()"",
$flagsas xs:string?:= ''
) as xs:string
Properties

This function is deterministic, context-independent, and focus-independent.

Rules

If $value is the empty sequence, it is interpreted as the zero-length string.

If the $flags argument is omitted or if it is an empty sequence, the effect is the same as setting $flags to a zero-length string. Flags are defined in 6.2 Flags.

The string $value is matched against the regular expression $pattern, using the supplied $flags, to obtain a set of disjoint matching segments. A replacement string R for each of these segments (say M) is determined by the value of the $replacement argument, by applying the first of the following rules that applies:

  • If $replacement is absent or empty, R is a zero-length string.

  • If $replacement is a function item F, then R is obtained by calling F, and then applying the function fn:string to the result.

    The first argument to F is the string to be replaced, provided as xs:untypedAtomic.

    The second argument to F provides the captured groups as an xs:untypedAtomic sequence. The Nth item in this sequence is the string value of the segment captured by the Nth capturing subexpression. If the Nth capturing subexpression was not matched, the Nth item will be the zero-length string.

    Note that the rules for function coercion mean that the function actually supplied for F may be an arity-1 function: the second argument does not need to be declared if it is not used.

  • If $replacement is a string and the q flag is present, R is the value of $replacement.

  • Otherwise, the value of $replacement is processed as follows.

    Within the supplied $replacement string, a variable marker $N (where N is an unsigned integer) may be used to refer to the Nth captured group associated with M. The replacement string R is obtained by replacing each of these variable markers with the string value of the relevant captured group. The variable marker $0 refers to the substring captured by the regular expression as a whole.

    A literal $ character within the replacement string must be written as \$, and a literal \ character must be written as \\.

    More specifically, the rules are as follows, where S is the number of capturing subexpressions in the regular expression, and N is the decimal number formed by taking all the digits that consecutively follow the $ character in $replacement:

    1. If N=0, then the variable is replaced by the string value of M.

    2. If 1<=N<=S, then the variable marker is replaced by the string value of the Nth captured group associated with M. If the Nth parenthesized sub-expression was not matched, then the variable marker is replaced by the zero-length string.

    3. If S<N<=9, then the variable marker is replaced by the zero-length string.

    4. Otherwise (if N>S and N>9), the last digit of N is taken to be a literal character to be included “as is” in the replacement string, and the rules are reapplied using the number N formed by stripping off this last digit.

      For example, if the replacement string is "$23" and there are 5 substrings, the result contains the value of the substring that matches the second capturing subexpression, followed by the digit 3.

The function returns the xs:string that is obtained by replacing each of the disjoint matching segments of $value with the corresponding value of R.

Error Conditions

A dynamic error is raised [err:FORX0002] if the value of $pattern is invalid according to the rules described in section 6.1 Regular expression syntax.

A dynamic error is raised [err:FORX0001] if the value of $flags is invalid according to the rules described in section 6.2 Flags.

In the absence of the q flag, a dynamic error is raised [err:FORX0004] if the value of $replacement contains a dollar sign ($) character that is not immediately followed by a digit 0-9 and not immediately preceded by a backslash (\).

In the absence of the q flag, a dynamic error is raised [err:FORX0004] if the value of $replacement contains a backslash (\) character that is not part of a \\ pair, unless it is immediately followed by a dollar sign ($) character.

A dynamic error is raised [err:FORX0005] if both the $replacement and $action arguments are supplied, and neither is an empty sequence.

Notes

If the input string contains no substring that matches the regular expression, the result of the function is a single string identical to the input string.

If two overlapping substrings of $value both match the $pattern, then only the first one (that is, the one whose first character comes first in the $value string) is replaced.

If two alternatives within the pattern both match at the same position in the $input, then the match that is chosen is the one matched by the first alternative. For example:

 replace("abcd", "(ab)|(a)", "[1=$1][2=$2]") returns "[1=ab][2=]cd"

The rules for disjoint matching segments allow a zero-length matching segment to immediately follow a non-zero-length matching segment (they are not considered to overlap). This means, for example, that the regular expression .* will typically produce two matches: one matching segment containing all the characters in the input string, and a second zero-length matching seqment at the end position of the string.

Examples
Expression:

replace("abracadabra", "bra", "*")

Result:

"a*cada*"

Expression:

replace("abracadabra", "a.*a", "*")

Result:

"*"

Expression:

replace("abracadabra", "a.*?a", "*")

Result:

"*c*bra"

Expression:

replace("abracadabra", "a", "")

Result:

"brcdbr"

Expression:

replace("abracadabra", "a(.)", "a$1$1")

Result:

"abbraccaddabbra"

Expression:

replace("AAAA", "A+", "b")

Result:

"b"

Expression:

replace("AAAA", "A+?", "b")

Result:

"bbbb"

Expression:

replace("In the beginning was the Word", "\b", "|")

Result:

"|In| |the| |beginning| |was| |the| |Word|"

Expression:

replace("abcd!", "[a-z](?=.*(.)$)", "$0$1")

Result:

"a!b!c!d!!"

Expression:

replace("darted", "^(.*?)d(.*)$", "$1c$2")

Result:

"carted"

(Only the first d is replaced.)

Expression:
replace("abracadabra", "bra", upper-case#1)
Result:
"aBRAcadaBRA"
Expression:
replace("Chapter 9", "[0-9]+", fn { . + 1 })
Result:
"Chapter 10"
Expression:
replace(
  "LHR to LAX",
  "\b[A-Z]{3}\b",
  { 'LAX': 'Los Angeles', 'LHR': 'London' }
)
Result:
"London to Los Angeles"
Expression:
replace(
  "57°43′30″",
  "([0-9]+)°([0-9]+)′([0-9]+)″",
  fn($s, $groups) {
    string($groups[1] + $groups[2] ÷ 60 + $groups[3] ÷ 3600) || '°'
  }
)
Result:
"57.725°"

6.3.3 fn:tokenize

Changes in 4.0 (next | previous)

  1. The second argument can now be an empty sequence.  [Issue 895 PR 901 16 December 2023]

  2. It is now permitted for the regular expression to match a zero-length string.  [ PR 1856]

Summary

Returns a sequence of strings constructed by splitting the input wherever a separator is found; the separator is any substring that matches a given regular expression.

Signature
fn:tokenize(
$valueas xs:string?,
$patternas xs:string?:= (),
$flagsas xs:string?:= ""
) as xs:string*
Properties

This function is deterministic, context-independent, and focus-independent.

Rules

The following rules apply when the $pattern argument is omitted, or is set to an empty sequence:

  • The function splits the supplied string at whitespace boundaries.

  • More specifically, calling fn:tokenize($value)or fn:tokenize($value, ()) is equivalent to calling fn:tokenize(fn:normalize-space($value), ' ')) where the second argument is a single space character (x20).

  • The $flags argument is ignored.

The following rules apply when the $pattern argument is supplied as a single string:

  • If the $flags argument is omitted or if it is an empty sequence, the effect is the same as setting $flags to a zero-length string. Flags are defined in 6.2 Flags.

  • If $value is the empty sequence, or if $value is the zero-length string, the function returns the empty sequence.

  • The function returns a sequence of strings formed by breaking the $value string into a sequence of strings, treating any substring that matches $pattern as a separator. The separators themselves are not returned.

  • More specifically:

    • Let M0 be the sequence of disjoint matching segments that results from matching $value against $pattern in the presence of $flags.

    • Unless the first segment in M0 is zero-length and starts at the first character position of $value, prepend a zero-length segment that starts at the start of $value: call the result M1.

    • Unless the last segment in M1 is zero-length and starts at the last character position of $value (that is, the character position after the last character), append a zero-length segment that starts at the last character position of $value. Call the result M2.

    • For each pair of adjacent segments in M2 (say, Sn and Sn+1), construct a string (possibly zero-length) that is the substring of $value containing all characters that follow Sn and that precede Sn+1. Return this sequence of strings, in order.

Error Conditions

A dynamic error is raised [err:FORX0002] if the value of $pattern is invalid according to the rules described in section 6.1 Regular expression syntax.

A dynamic error is raised [err:FORX0001] if the value of $flags is invalid according to the rules described in section 6.2 Flags.

Notes

If the input string is not zero length, and no separators are found in the input string, the result of the function is a single string identical to the input string.

For the one-argument form of the function:

  • The function has a similar effect to the two-argument form with \s+ as the separator pattern, except that the one-argument form strips leading and trailing whitespace, whereas the two-argument form delivers an extra zero-length token if leading or trailing whitespace is present.

  • The separator used is any sequence of tab (U+0009 (TAB) ), newline (U+000A (NEWLINE) ), carriage return (U+000D (CARRIAGE RETURN) ) or space (U+0020 (SPACE) ) characters. This is the same as the separator recognized by list-valued attributes as defined in XSD. It is not the same as the separator recognized by list-valued attributes in HTML5, which also treats form-feed (U+000C (FORM FEED) ) as whitespace. If it is necessary to treat form-feed as a separator, an explicit separator pattern should be used.

For the two-argument form of the function:

  • The function returns no information about the separators that were found in the string. If this information is required, the fn:analyze-string function can be used instead. Alternatively, zero-width assertions can be used to identify separators. For example, using the regular expression (?<=,) will start a new token after every comma, including the comma as part of the previous token.

  • If a separator occurs at the start of $value, and is not zero-length, the result sequence will start with a zero-length string. Similarly, zero-length strings will also occur in the result sequence if a non-zero-length separator occurs at the end of $value, or if two adjacent substrings match the supplied $pattern.

  • If two alternatives within the supplied $pattern both match at the same position in the $value string, then the match that is chosen is the first. For example:

     tokenize("abracadabra", "(ab)|(a)") returns ("", "r", "c", "d", "r", "")
  • The pattern may match zero-length segments of the input string. For example, the expression tokenize("Do not eat", "\b") returns the sequence "Do", " ", "not", " ", "eat".

  • A string may be split into individual characters (producing the same effect as the fn:characters function) by using the empty regular expression (for example, tokenize("xyz", ""), or any other regular expression such as .?? that matches every zero-length string, regardless of position.

    Unlike the split method in some other popular languages, however, not every regular expression that matches a zero-length string produces this behavior: for example the regular expression \b splits the string before and after every word.

Examples
Expression:

tokenize(" red green blue ")

Result:

"red", "green", "blue"

Expression:

tokenize("The cat sat on the mat", "\s+")

Result:

"The", "cat", "sat", "on", "the", "mat"

Expression:

tokenize(" red green blue ", "\s+")

Result:

"", "red", "green", "blue", ""

Expression:

tokenize("1, 15, 24, 50", ",\s*")

Result:

"1", "15", "24", "50"

Expression:

tokenize("1,15,,24,50,", ",")

Result:

"1", "15", "", "24", "50", ""

Expression:

fn:tokenize("the end", "\b")

Result:

"the", " ", "end"

Expression:

fn:tokenize("California", "")

Result:

"C", "a", "l", "i", "f", "o", "r", "n", "i", "a"

Expression:
tokenize(
  "Some unparsed <br> HTML <BR> text",
  "\s*<br>\s*", "i"
)
Result:
"Some unparsed", "HTML", "text"

6.3.4 fn:analyze-string

Changes in 4.0 (next | previous)

  1. The output of the function is extended to allow the represention of captured groups found within lookahead assertions.  [ PR 1856]

  2. It is now permitted for the regular expression to match a zero-length string.  [ PR 1856]

Summary

Analyzes a string using a regular expression, returning an XML structure that identifies which parts of the input string matched or failed to match the regular expression, and in the case of matched substrings, which substrings matched each capturing group in the regular expression.

Signature
fn:analyze-string(
$valueas xs:string?,
$patternas xs:string,
$flagsas xs:string?:= ""
) as element(fn:analyze-string-result)
Properties

This function is nondeterministic, context-independent, and focus-independent.

Rules

If the $flags argument is omitted or if it is an empty sequence, the effect is the same as setting $flags to a zero-length string. Flags are defined in 6.2 Flags.

If $value is the empty sequence the function behaves as if $value were the zero-length string.

The function returns an element node whose local name is analyze-string-result. This element and all its descendant elements have the namespace URI http://www.w3.org/2005/xpath-functions. The namespace prefix is implementation-dependent. The children of this element are a sequence of fn:match and fn:non-match elements. This sequence is formed by breaking the $value string into a sequence of strings, returning any substring that matches $pattern as the content of an fn:match element, and any intervening substring as the content of an fn:non-match element.

More specifically, the function starts by matching the regular expression against the string, using the supplied $flags, to obtain the disjoint matching segments. For each such segment it constructs an fn:match child, whose string value is the string value of the segment. Before, between, or after these fn:match elements, as required to ensure that the string value of the fn:analyze-string-result element is the same as $value, it inserts fn:non-match elements. The content of an fn:non-match element is always a single (non-empty) text node, and two fn:non-match elements never appear as adjacent siblings.

The captured groups for each disjoint matching segment are represented using fn:group or fn:lookahead-group children of the corresponding fn:match element. Groups captured by a subexpression within a lookahead assertion are referred to as lookahead groups; those not within a lookahead assertion are called ordinary groups.

The content of a role="element-name"fn:match element is in general:

  • A sequence of text nodes and fn:group element children, whose string-values when concatenated comprise the string value of the matching segment, followed by

  • A sequence of zero or more fn:lookahead-group elements, representing the lookahead groups

The string value of an fn:match element may be empty.

An fn:group element with a nr attribute having the integer value N identifies the substring captured by an ordinary group, specifically the string value of the Nth captured group. For each ordinary capturing subexpression there will be at most one corresponding fn:group element in each fn:match element in the result.

By contrast, lookahead groups are represented by fn:lookahead-group elements, which (if they appear at all) must follow all text node and fn:group element children of the fn:match element. These groups may overlap the matching and non-matching substrings, and indeed may overlap each other. They must appear in ascending numerical order of group number. The attributes of the fn:lookahead-group element are as follows:

  • nr: the group number, based on the position of the capturing subexpression that captured the group;

  • value: the string value of the segment that was captured;

  • position: the one-based start position of the segment within the input string.

If the function is called twice with the same arguments, it is implementation-dependent whether the two calls return the same element node or distinct (but deep equal) element nodes. In this respect it is nondeterministic with respect to node identity.

The base URI of the element nodes in the result is implementation-dependent.

A schema is defined for the structure of the returned element: see D.1 Schema for the result of fn:analyze-string.

The result of the function will always be such that validation against this schema would succeed. However, it is implementation-defined whether the result is typed or untyped, that is, whether the elements and attributes in the returned tree have type annotations that reflect the result of validating against this schema.

Error Conditions

A dynamic error is raised [err:FORX0002] if the value of $pattern is invalid according to the rules described in section 6.1 Regular expression syntax.

A dynamic error is raised [err:FORX0001] if the value of $flags is invalid according to the rules described in section 6.2 Flags.

Notes

It is recommended that a processor that implements schema awareness should return typed nodes. The concept of “schema awareness”, however, is a matter for host languages to define and is outside the scope of the function library specification.

The declarations and definitions in the schema are not automatically available in the static context of the fn:analyze-string call (or of any other expression). The contents of the static context are host-language defined, and in some host languages are implementation-defined.

The schema defines the outermost element, analyze-string-result, in such a way that mixed content is permitted. In fact the element will only have element nodes (match and non-match) as its children, never text nodes. Although this might have originally been an oversight, defining the analyze-string-result element with mixed="true" allows it to be atomized, which is potentially useful (the atomized value will be the original input string), and the capability has therefore been retained for compatibility with the 3.0 version of this specification.

The rules for disjoint matching segments allow a zero-length matching segment to immediately follow a non-zero-length matching segment (they are not considered to overlap). This means, for example, that the regular expression .* will typically produce two matches: one matching segment containing all the characters in the input string, and a second zero-length matching seqment at the end position of the string.

Examples

In the following examples, the result document is shown in serialized form, with whitespace between the element nodes. This whitespace is not actually present in the result.

Expression:

analyze-string("The cat sat on the mat.", "\w+")

Result:
<analyze-string-result xmlns="http://www.w3.org/2005/xpath-functions">
  <match>The</match>
  <non-match> </non-match>
  <match>cat</match>
  <non-match> </non-match>
  <match>sat</match>
  <non-match> </non-match>
  <match>on</match>
  <non-match> </non-match>
  <match>the</match>
  <non-match> </non-match>
  <match>mat</match>
  <non-match>.</non-match>
</analyze-string-result>

(with whitespace added for legibility)

Expression:
analyze-string("08-12-03", "^(\d+)\-(\d+)\-(\d+)$")
Result:
<analyze-string-result xmlns="http://www.w3.org/2005/xpath-functions">
  <match>
    <group nr="1">08</group>-<group nr="2">12</group>-<group nr="3">03</group>
  </match>
</analyze-string-result>

(with whitespace added for legibility)

Expression:
analyze-string("A1,C15,,D24, X50,", "([A-Z])([0-9]+)")
Result:
<analyze-string-result xmlns="http://www.w3.org/2005/xpath-functions">
  <match>
    <group nr="1">A</group>
    <group nr="2">1</group>
  </match>
  <non-match>,</non-match>
  <match>
    <group nr="1">C</group>
    <group nr="2">15</group>
  </match>
  <non-match>,,</non-match>
  <match>
    <group nr="1">D</group>
    <group nr="2">24</group>
  </match>
  <non-match>, </non-match>
  <match>
    <group nr="1">X</group>
    <group nr="2">50</group>
  </match>
  <non-match>,</non-match>
</analyze-string-result>

(with whitespace added for legibility)

Expression:
analyze-string("Chapter 5", "(Chapter|Appendix)(?=\s+([0-9]+))")
Result:
<analyze-string-result xmlns="http://www.w3.org/2005/xpath-functions">
  <match>
    <group nr="1">Chapter</group>
    <lookahead-group nr="2" value="5" position="9"/>
  </match>
  <non-match> 5</non-match>  
</analyze-string-result>

(with whitespace added for legibility)

Expression:
analyze-string("There we go", "\b(?=\w+)")
Result:
<analyze-string-result xmlns="http://www.w3.org/2005/xpath-functions">
  <match><lookahead-group nr="1" value="There" position="1"/></match>
  <non-match>There </non-match>
  <match><lookahead-group nr="1" value="we" position="7"/></match>
  <non-match>we </non-match>
  <match><lookahead-group nr="1" value="go" position="10"/></match>
  <non-match>go</non-match>
</analyze-string-result>

(with whitespace added for legibility)

7 Processing URIs

This section specifies functions that manipulate URI values, either as instances of xs:anyURI or as strings.

FunctionMeaning
fn:decode-from-uriDecodes URI-escaped characters in a string.
fn:encode-for-uriEncodes reserved characters in a string that is intended to be used in the path segment of a URI.
fn:escape-html-uriEscapes a URI in the same way that HTML user agents handle attribute values expected to contain URIs.
fn:iri-to-uriConverts a string containing an IRI into a URI according to the rules of [RFC 3987].
fn:resolve-uriResolves a relative IRI reference against an absolute IRI.

7.5 fn:resolve-uri

Changes in 4.0 (next | previous)

  1. The optional second argument can now be supplied as an empty sequence.  [Issue 895 PR 901 16 December 2023]

Summary

Resolves a relative IRI reference against an absolute IRI.

Signature
fn:resolve-uri(
$hrefas xs:string?,
$baseas xs:string?:= ()
) as xs:anyURI?
Properties

This function is deterministic, context-dependent, and focus-independent. It depends on executable base URI.

Rules

The function is defined to operate on IRI references as defined in [RFC 3987], and the implementation must permit all arguments that are valid according to that specification. In addition, the implementation may accept some or all strings that conform to the rules for (absolute or relative) Legacy Extended IRI references as defined in [Legacy extended IRIs for XML resource identification]. For the purposes of this section, the terms IRI and IRI reference include these extensions, insofar as the implementation chooses to support them.

The following rules apply in order:

  1. If $href is the empty sequence, the function returns the empty sequence.

  2. If $href is an absolute IRI (as defined above), then it is returned unchanged.

  3. If the $base argument is not supplied, or is supplied as an empty sequence, then:

    1. If the executable base URIXP in the dynamic context is not absent, it is used as the effective value of $base.

    2. Otherwise, a dynamic error is raised: [err:FONS0005].

  4. The function resolves the relative IRI reference $href against the base IRI $base using the algorithm defined in [RFC 3986], adapted by treating any character that would not be valid in an RFC3986 URI or relative reference in the same way that RFC3986 treats unreserved characters. No percent-encoding takes place.

Error Conditions

The first form of this function resolves $href against the value of the base-uri property from the static context. A dynamic error is raised [err:FONS0005] if the base-uri property is not initialized in the static context.

A dynamic error is raised [err:FORG0002] if $href is not a valid IRI according to the rules of RFC3987, extended with an implementation-defined subset of the extensions permitted in LEIRI, or if it is not a suitable relative reference to use as input to the RFC3986 resolution algorithm extended to handle additional unreserved characters.

A dynamic error is raised [err:FORG0002] if $base is not a valid IRI according to the rules of RFC3987, extended with an implementation-defined subset of the extensions permitted in LEIRI, or if it is not a suitable IRI to use as input to the chosen resolution algorithm (for example, if it is a relative IRI reference or if it is a non-hierarchic URI). In XPath 4.0, attempting to resolve against an absolute URI that includes a fragment identifier is no longer an error, the fragment identifier is simply ignored. A narrow reading of RFC 3986 might seem to forbid this, but in practice the interpretation is non-controversial and the practice is widely supported.

A dynamic error is raised [err:FORG0009] if the chosen resolution algorithm fails for any other reason.

Notes

Resolving a URI does not dereference it. This is merely a syntactic operation on two strings.

The algorithms in the cited RFCs include some variations that are optional or recommended rather than mandatory; they also describe some common practices that are not recommended, but which are permitted for backwards compatibility. Where the cited RFCs permit variations in behavior, so does this specification.

Throughout this family of specifications, the phrase "resolving a relative URI (or IRI) reference" should be understood as using the rules of this function, unless otherwise stated.

RFC3986 defines an algorithm for resolving relative references in the context of the URI syntax defined in that RFC. RFC3987 describes a modification to that algorithm to make it applicable to IRIs (specifically: additional characters permitted in an IRI are handled the same way that RFC3986 handles unreserved characters). The LEIRI specification does not explicitly define a resolution algorithm, but suggests that it should not be done by converting the LEIRI to a URI, and should not involve percent-encoding. This specification fills this gap by defining resolution for LEIRIs in the same way that RFC3987 defines resolution for IRIs, that is by specifying that additional characters are handled as unreserved characters.

7.6 Parsing and building URIs

This section specifies functions that parse strings as URIs, to identify their structure, and construct URI strings from their structured representation.

Some URI schemes are hierarchical and some are non-hierarchical. Implementations must treat the following schemes as non-hierarchical: jar, mailto, news, tag, tel, and urn. Whether additional schemes are known to be non-hierarchical implementation-defined. If a scheme is not known to be non-hierarchical, it must be treated as hierarchical.

FunctionMeaning
fn:parse-uriParses the URI provided and returns a map of its parts.
fn:build-uriConstructs a URI from the parts provided.

Both functions use a structured representation of a URI as defined in the next section.

7.6.2 fn:parse-uri

Changes in 4.0 (next | previous)

  1. New in 4.0  [Issues 72 389 390  17 October 2022]

Summary

Parses the URI provided and returns a map of its parts.

Signature
fn:parse-uri(
$valueas xs:string?,
$optionsas map(*)?:= {}
) as uri-structure-record?
Properties

This function is deterministic, context-independent, and focus-independent.

Rules

If $value is an empty sequence, the result is an empty sequence.

The function parses the $value provided, returning a map containing its constituent parts: scheme, authority components, path, etc. In addition to parsing URIs as defined by [RFC 3986] (and [RFC 3987]), this function also attempts to account for strings that are not valid URIs but that often appear in URI-adjacent spaces, such as file names. Not all such strings can be successfully parsed as URIs.

The following options are available:

record(
allow-deprecated-features?as xs:boolean,
omit-default-ports?as xs:boolean,
unc-path?as xs:boolean
)
KeyMeaning

allow-deprecated-features?

Indicates that deprecated URI features should be returned
  • Type: xs:boolean

  • Default: false

omit-default-ports?

Indicates that a port number that is the same as the default port for a given scheme should be omitted.
  • Type: xs:boolean

  • Default: false

unc-path?

Indicates that an input URI that begins with two or more leading slashes should be interprted as a Windows Universal Naming Convention Path. (Specifically: that it has the file: scheme.)
  • Type: xs:boolean

  • Default: false

This function is described as a series of transformations over the input string to identify the parts of a URI that are present. Some portions of the URI are identified by matching with a regular expression. This approach is designed to make the description clear and unambiguous; it is not implementation advice. Comparison of scheme and authority components is case insensitive.

Processing begins with a string that is equal to the $value. If the string contains any backslashes (\), replace them with forward slashes (/).

Strip off the fragment identifier and any query:

  • If the string matches ^(.*?)#(.*)$, the string is the first match group and the fragment is the second match group. Otherwise, the string is unchanged and the fragment is the empty sequence. If a fragment is present, it is URI decoded. If the fragment is the empty string, it is discarded and the fragment is the empty sequence.

  • If the string matches ^(.*?)\?(.*)$, the string is the first match group and the query is the second match group. Otherwise, the string is unchanged and the query is the empty sequence. If the query is the empty string, it is discarded and the query is the empty sequence.

Attempt to identify the scheme:

  • If the string matches ^([a-zA-Z][A-Za-z0-9\+\-\.]+):(.*)$:

    • the scheme is the first match group and

    • the string is the second match group.

  • Otherwise, the scheme is the empty sequence and the string is unchanged.

If the scheme is not empty and the fragment is empty, absolute is true. Otherwise, absolute is the empty sequence. (But see the discussion of hierarchical URIs, below.)

If scheme is the empty sequence or file:

  • If the string matches ^/*([a-zA-Z][:|].*)$:

    • the scheme is file and

    • the string is a single slash / followed by the first match group with the second character changed to :, if necessary.

  • Otherwise, if unc-path is true:

    • the scheme is file and

    • the string is unchanged.

  • Finally, if neither of the preceding cases apply:

    • the scheme remains the empty sequence and

    • the string is unchanged.

Now that the scheme, if there is one, has been identified, determine if the URI is hierarchical:

  • If the scheme is known to be hierarchical, or known not to be hierarchical, then hierarchical is set accordingly. If the implementation does not know if a scheme is or is not hierarchical, the hierarchical setting depends on the string: if the string is the empty string, hierarchical is the empty sequence (i.e. not known), otherwise hierarchical is true if string begins with / and false otherwise.

If the URI is not hierarchical, absolute is the empty sequence.

Identify the remaining components according to the scheme and whether or not the URI is hierarchical.

  • If the scheme is file:

    • The authority is the empty sequence.

    • If unc-path is true and the string matches ^/*(//[^/].*)$: then filepath, and string are both the first match group.

    • If the string begins ^//*[A-Za-z]:/ then all but one leading slash is removed from string and the filepath is the string with all leading slashes removed.

    • Otherwise, the filepath and string are the string with any sequence of leading slashes replaced by a single slash.

  • If the scheme is hierarchical:

    • If the string matches ^//([^/]+)$, the authority is the first match group and the string is empty.

    • If the string matches ^//([^/]*)(/.*)$, the authority is the first match group and the string is the second match group.

    • Otherwise, the authority is the empty sequence and the string is unchanged.

  • If the scheme is not hierarchical:

    • The authority is the empty sequence and the string is unchanged.

If the authority matches ^(([^@]*)@)(.*)(:([^:]*))?$, then the userinfo is match group 2, otherwise userinfo is the empty sequence. If userinfo is present and contains a non-empty password, then userinfo is discarded and set to the empty sequence unless the allow-deprecated-features option is true.

When parsing the authority to find the host, there are four possibilities: the host can be a registered name (e.g., example.com), an IPv4 address (e.g., 127.0.0.1), an IPv6 (or IPvFuture) address (e.g., [::1]), or an error if there is an open square bracket ([) not matched by a close square bracket (]). In a properly constructed RFC 3986 URI, the only place where square brackets may occur is around the IPv6/IPvFuture IP address.

  1. If the authority matches ^(([^@]*)@)?(\[[^\]]*\])(:([^:]*))?$, then the host is match group 3, otherwise

  2. If the authority matches ^(([^@]*)@)?\[.*$ then [err:FOUR0001] is raised, otherwise

  3. If the authority matches ^(([^@]*)@)?([^:]+)(:([^:]*))?$, then the host is match group 3, otherwise

  4. the host is the empty sequence.

This function does not attempt to decode the components of the host.

Similar care must be taken to match the port because an IPv6/IPvFuture address may contain a colon.

  • If the authority matches ^(([^@]*)@)?(\[[^\]]*\])(:([^:]*))?$, then the port is match group 5.

  • Otherwise, if the authority matches ^(([^@]*)@)?([^:]+)(:([^:]*))?$, then the port is match group 5.

  • Otherwise, the port is the empty sequence.

If the omit-default-ports option is true, the port is discarded and set to the empty sequence if the port number is the same as the default port for the given scheme. Implementations should recognize the default ports for http (80), https (443), ftp (21), and ssh (22). Exactly which ports are recognized is implementation-defined.

If the string is the empty string, then path is the empty sequence, otherwise path is the whole string. If the scheme is the empty sequence, filepath is also the whole string.

A path-segments sequence is constructed by tokenizing the string on / (solidus) and applying uri decoding on each token.

Note:

The path and path-segments properties both contain the path portion of the URI. The different formats only become important when the path contains encoded delimiters.

Consider /path%2Fsegment. An application may want to decode that, using /path/segment in a database query, for example. At the same time, an application may wish to modify the URI and then reconstruct it.

In the string form, decoding %2F to / is not reversible. In the path-segments form, the path is broken into discrete segments where the syntactic delimiters occur. This means the encoded delimiters can be decoded without introducing ambiguity: ("", "path/segment"). In this format, the decoding is reversible: escape the non-syntactic delimiters before reconstructing the path with the syntactic ones.

A consequence of constructing the path-segments this way is that an empty string appears before the first /, if the path begins with a /, after the last /, if the path ends with a /, and between consecutive / characters. (If the path consists of a single /, that / counts as both the first and last /, producing a segment list containing two empty strings.)

The empty strings may seem unnecessary at first glance, but they assure that the path can be reconstructed by joining the segments together again without having to handle the presence or absence of a leading or trailing / as special cases.

Applying uri decoding is equivalent to calling fn:decode-from-uri on the string.

The query-parameters value is constructed as follows. Start with an empty map. Tokenize the query on the & (ampersand). For each token, identify the key and the value. If the token contains an equal sign (=), the key is the string that precedes the first equal sign, uri decoded, and the value is the remainder of the token, after the first equal sign, uri decoded. If the token does not contain an equal sign, key is the empty string and the value is equal to the token, uri decoded. Add the key/value pair to the map. If the key already exists in the map, add the value to a list of values associated with that key. The resulting map, when all tokens have been processed, is the query-parameters map.

If the filepath is not the empty sequence, it is uri decoded. On a Windows system, any forward slashes in the path may be replaced with backslashes.

A uri-structure-record is returned. The record should be populated with only those keys that have a non-empty value (keys whose value is the empty sequence should be omitted).

Implementations may implement additional or different rules for URIs that have a scheme or pattern that they recognize. An implementation might choose to parse jar: URIs with special rules, for example, since they extend the syntax in ways not defined by [RFC 3986]. Implementations may add additional keys to the map. The meaning of those keys is implementation-defined.

Error Conditions

A dynamic error is raised [err:FOUR0001] if the URI contains an open square bracket in the authority component that is not followed by a close square bracket.

Notes

Like fn:resolve-uri, this function handles the additional characters allowed in [RFC 3987] IRIs in the same way that other unreserved characters are handled.

Unlike fn:resolve-uri, this function is not attempting to resolve one URI against another and consequently, the errors that can arise under those circumstances do not apply here. The fn:parse-uri function will accept strings that would raise errors if resolution was attempted; see fn:build-uri.

Examples

In the examples that follow, keys with values that are null or an empty sequence are elided for editorial clarity. String literals that include an ampersand character are written as string templates (for example `Barnes&Noble`) to ensure that the examples work in both XPath and XQuery.

Expression:
parse-uri("http://qt4cg.org/specifications/xpath-functions-40/Overview.html#parse-uri")
Result:
{
  "authority": "qt4cg.org",
  "fragment": "parse-uri",
  "hierarchical": true(),
  "host": "qt4cg.org",
  "path": "/specifications/xpath-functions-40/Overview.html",
  "path-segments": ("", "specifications", "xpath-functions-40", "Overview.html"),
  "scheme": "http",
  "uri": "http://qt4cg.org/specifications/xpath-functions-40/Overview.html#parse-uri"
}
Expression:
parse-uri("http://www.ietf.org/rfc/rfc2396.txt")
Result:
{
  "authority": "www.ietf.org",
  "hierarchical": true(),
  "absolute": true(),
  "host": "www.ietf.org",
  "path": "/rfc/rfc2396.txt",
  "path-segments": ("", "rfc", "rfc2396.txt"),
  "scheme": "http",
  "uri": "http://www.ietf.org/rfc/rfc2396.txt"
}
Expression:
parse-uri("https://example.com/path/to/file")
Result:
{
  "authority": "example.com",
  "path": "/path/to/file",
  "scheme": "https",
  "path-segments": ("", "path", "to", "file"),
  "host": "example.com",
  "hierarchical": true(),
  "absolute": true(),
  "uri": "https://example.com/path/to/file"
}
Expression:
parse-uri(
  `https://example.com:8080/path?s=%22hello world%22&sort=relevance`
)
Result:
{
  "authority": "example.com:8080",
  "hierarchical": true(),
  "absolute": true(),
  "host": "example.com",
  "path": "/path",
  "path-segments": ("", "path"),
  "port": 8080,
  "query": `s=%22hello world%22&sort=relevance`,
  "query-parameters": {
    "s": """hello world""",
    "sort": "relevance"
  },
  "scheme": "https",
  "uri": `https://example.com:8080/path?s=%22hello world%22&sort=relevance`
}
Expression:
parse-uri("https://user@example.com/path/to/file")
Result:
{
  "authority": "user@example.com",
  "hierarchical": true(),
  "absolute": true(),
  "host": "example.com",
  "path": "/path/to/file",
  "path-segments": ("", "path", "to", "file"),
  "scheme": "https",
  "uri": "https://user@example.com/path/to/file",
  "userinfo": "user"
}
Expression:
parse-uri("ftp://ftp.is.co.za/rfc/rfc1808.txt")
Result:
{
  "authority": "ftp.is.co.za",
  "hierarchical": true(),
  "absolute": true(),
  "host": "ftp.is.co.za",
  "path": "/rfc/rfc1808.txt",
  "path-segments": ("", "rfc", "rfc1808.txt"),
  "scheme": "ftp",
  "uri": "ftp://ftp.is.co.za/rfc/rfc1808.txt"
}
Expression:
parse-uri("file:////uncname/path/to/file")
Result:
{
  "filepath": "/uncname/path/to/file",
  "hierarchical": true(),
  "absolute": true(),
  "path": "/uncname/path/to/file",
  "path-segments": ("", "uncname", "path", "to", "file"),
  "scheme": "file",
  "uri": "file:////uncname/path/to/file"
}
Expression:
parse-uri("file:///c:/path/to/file")
Result:
{
  "filepath": "c:/path/to/file",
  "hierarchical": true(),
  "absolute": true(),
  "path": "/c:/path/to/file",
  "path-segments": ("", "c:", "path", "to", "file"),
  "scheme": "file",
  "uri": "file:///c:/path/to/file"
}
Expression:
parse-uri("file:/C:/Program%20Files/test.jar")
Result:
{
  "filepath": "C:/Program Files/test.jar",
  "hierarchical": true(),
  "absolute": true(),
  "path": "/C:/Program%20Files/test.jar",
  "path-segments": ("", "C:", "Program Files", "test.jar"),
  "scheme": "file",
  "uri": "file:/C:/Program%20Files/test.jar"
}
Expression:
parse-uri("file:\\c:\path\to\file")
Result:
{
  "filepath": "c:/path/to/file",
  "hierarchical": true(),
  "absolute": true(),
  "path": "/c:/path/to/file",
  "path-segments": ("", "c:", "path", "to", "file"),
  "scheme": "file",
  "uri": "file:\\c:\path\to\file"
}
Expression:
parse-uri("file:\c:\path\to\file")
Result:
{
  "filepath": "c:/path/to/file",
  "hierarchical": true(),
  "absolute": true(),
  "path": "/c:/path/to/file",
  "path-segments": ("", "c:", "path", "to", "file"),
  "scheme": "file",
  "uri": "file:\c:\path\to\file"
}
Expression:
parse-uri("c:\path\to\file")
Result:
{
  "filepath": "c:/path/to/file",
  "hierarchical": true(),
  "path": "/c:/path/to/file",
  "path-segments": ("", "c:", "path", "to", "file"),
  "scheme": "file",
  "uri": "c:\path\to\file"
}
Expression:
parse-uri("/path/to/file")
Result:
{
  "filepath": "/path/to/file",
  "hierarchical": true(),
  "path": "/path/to/file",
  "path-segments": ("", "path", "to", "file"),
  "uri": "/path/to/file"
}
Expression:
parse-uri("#testing")
Result:
{
  "fragment": "testing",
  "uri": "#testing"
}
Expression:
parse-uri("?q=1")
Result:
{
  "query": "q=1",
  "query-parameters":{
    "q": "1"
  },
  "uri": "?q=1"
}
Expression:
parse-uri("ldap://[2001:db8::7]/c=GB?objectClass?one")
Result:
{
  "authority": "[2001:db8::7]",
  "hierarchical": true(),
  "absolute": true(),
  "host": "[2001:db8::7]",
  "path": "/c=GB",
  "path-segments": ("", "c=GB"),
  "query": "objectClass?one",
  "query-parameters":{
    "": "objectClass?one"
  },
  "scheme": "ldap",
  "uri": "ldap://[2001:db8::7]/c=GB?objectClass?one"
}
Expression:
parse-uri("mailto:John.Doe@example.com")
Result:
{
  "hierarchical": false(),
  "path": "John.Doe@example.com",
  "path-segments": "John.Doe@example.com",
  "scheme": "mailto",
  "uri": "mailto:John.Doe@example.com"
}
Expression:
parse-uri("news:comp.infosystems.www.servers.unix")
Result:
{
  "hierarchical": false(),
  "path": "comp.infosystems.www.servers.unix",
  "path-segments": "comp.infosystems.www.servers.unix",
  "scheme": "news",
  "uri": "news:comp.infosystems.www.servers.unix"
}
Expression:
parse-uri("tel:+1-816-555-1212")
Result:
{
  "hierarchical": false(),
  "path": "+1-816-555-1212",
  "path-segments": " 1-816-555-1212",
  "scheme": "tel",
  "uri": "tel:+1-816-555-1212"
}
Expression:
parse-uri("telnet://192.0.2.16:80/")
Result:
{
  "authority": "192.0.2.16:80",
  "hierarchical": true(),
  "absolute": true(),
  "host": "192.0.2.16",
  "path": "/",
  "path-segments": ("", ""),
  "port": 80,
  "scheme": "telnet",
  "uri": "telnet://192.0.2.16:80/"
}
Expression:
parse-uri("urn:oasis:names:specification:docbook:dtd:xml:4.1.2")
Result:
{
  "hierarchical": false(),
  "path": "oasis:names:specification:docbook:dtd:xml:4.1.2",
  "path-segments": "oasis:names:specification:docbook:dtd:xml:4.1.2",
  "scheme": "urn",
  "uri": "urn:oasis:names:specification:docbook:dtd:xml:4.1.2"
}
Expression:
parse-uri("tag:textalign.net,2015:ns")
Result:
{
  "hierarchical": false(),
  "path": "textalign.net,2015:ns",
  "path-segments": "textalign.net,2015:ns",
  "scheme": "tag",
  "uri": "tag:textalign.net,2015:ns"
}
Expression:
parse-uri("tag:jan@example.com,1999-01-31:my-uri")
Result:
{
  "hierarchical": false(),
  "path": "jan@example.com,1999-01-31:my-uri",
  "path-segments": "jan@example.com,1999-01-31:my-uri",
  "scheme": "tag",
  "uri": "tag:jan@example.com,1999-01-31:my-uri"
}

This example uses the algorithm described above, not an algorithm that is specifically aware of the jar: scheme.

Expression:
parse-uri("jar:file:/C:/Program%20Files/test.jar!/foo/bar")
Result:
{
  "hierarchical": false(),
  "path": "file:/C:/Program%20Files/test.jar!/foo/bar",
  "path-segments": ("file:", "C:", "Program Files", "test.jar!", "foo", "bar"),
  "scheme": "jar",
  "uri": "jar:file:/C:/Program%20Files/test.jar!/foo/bar"
}

This example demonstrates that parsing the URI treats non-URI characters in lexical IRIs as “unreserved characters”. The rationale for this is given in the description of fn:resolve-uri.

Expression:
parse-uri("http://www.example.org/Dürst")
Result:
{
  "authority": "www.example.org",
  "hierarchical": true(),
  "absolute": true(),
  "host": "www.example.org",
  "path": "/Dürst",
  "path-segments": ("", "Dürst"),
  "scheme": "http",
  "uri": "http://www.example.org/Dürst"
}

This example demonstrates the use of | instead of : in a Windows path.

Expression:
parse-uri("c|/path/to/file")
Result:
{
  "filepath": "c:/path/to/file",
  "hierarchical": true(),
  "path": "/c:/path/to/file",
  "path-segments": ("", "c:", "path", "to", "file"),
  "scheme": "file",
  "uri": "c|/path/to/file"
}

This example demonstrates the use of | instead of : in a Windows path with an explicit file: scheme.

Expression:
parse-uri("file://c|/path/to/file")
Result:
{
  "filepath": "c:/path/to/file",
  "hierarchical": true(),
  "absolute": true(),
  "path": "/c:/path/to/file",
  "path-segments": ("", "c:", "path", "to", "file"),
  "scheme": "file",
  "uri": "file://c|/path/to/file"
}

7.6.3 fn:build-uri

Changes in 4.0 (next | previous)

  1. New in 4.0  [Issues 72 389 390 PRs 1423 1413 17 October 2022]

Summary

Constructs a URI from the parts provided.

Signature
fn:build-uri(
$partsas uri-structure-record,
$optionsas map(*)?:= {}
) as xs:string
Properties

This function is deterministic, context-dependent, and focus-independent.

Rules

A URI is composed from a scheme, authority, path, query, and fragment.

The following options are available:

record(
allow-deprecated-features?as xs:boolean,
omit-default-ports?as xs:boolean,
unc-path?as xs:boolean
)
KeyMeaning

allow-deprecated-features?

Indicates that deprecated URI features should be returned
  • Type: xs:boolean

  • Default: false

omit-default-ports?

Indicates that a port number that is the same as the default port for a given scheme should be omitted.
  • Type: xs:boolean

  • Default: false

unc-path?

Indicates that the URI represents a Windows Universal Naming Convention Path.
  • Type: xs:boolean

  • Default: false

The components are derived from the contents of the $parts map. To simplify the description below, a value is considered to be present in the map if the relevant field exists and is non-empty.

If the scheme key is present in the map, the URI begins with the value of that key. A URI is considered to be non-hierarchical if either the hierarchical key is present in the $parts map with the value false or if the scheme is known to be non-hierarchical. (In other words, schemes are hierarchical by default.)

  • If the scheme is known to be non-hierarchical, it is delimited by a trailing :.

  • Otherwise, if the scheme is file and the unc-path option is true, the scheme is delimited by a trailing :////.

  • Otherwise, the scheme is delimited by a trailing ://.

For simplicity of exposition, we take the userinfo, host, and port values from the map and imagine they are stored in variables with the same name. If the key is not present in the map, the value of the variable is set to the empty sequence.

If $userinfo is non-empty and contains a non-empty password, then $userinfo is set to the empty sequence unless the allow-deprecated-features option is true.

If the omit-default-ports option is true then the $port is set to the empty sequence if the port number is the same as the default port for the given scheme. Implementations should recognize the default ports for http (80), https (443), ftp (21), and ssh (22). Exactly which ports are recognized is implementation-defined.

If any of $userinfo, $host, or $port exist, the following authority is added to the URI under construction:

concat(
  if (exists($userinfo)) { $userinfo || "@" },
  $host,
  if (exists($port)) { ":" || $port }
)

If none of userinfo, host, or port is present, and authority is present, the value of the authority key is added to the URI. (In this case, no attempt is made to determine if a password or standard port are present, the authority value is simply added to the string.)

The fn:parse-uri function removes percent-escaping when it constructs the path-segments, query-parameters, and fragment properties. That’s often the most convenient behavior but, in order to reconstruct a URI from them, special escaping rules apply. These rules protect delimiters without encoding additional characters unnecessarily. The rules for path-segments, query-parameters, and fragment are slightly different because the URI encoding conventions are slightly different in each case.

An application with more stringent requirements can construct a path or query that satisfies the requirements and leave the path-segments and/or query-parameters keys out of the map.

  • If the path-segments key exists in the map, then the path is constructed from the segments. To construct the path, the possibly encoded segments are concatentated together, separated by U+002F (SOLIDUS, FORWARD SLASH, /) characters.

    The rules for encoding the path segments are different for hierarchical and non-hierarchical URIs. If the URI is non-hierarchical, no encoding is performed on the segments. Otherwise, each segment is encoded by replacing any control characters (codepoints less than 0x20) and exclusively the following characters with their percent-escaped forms: U+0020 (SPACE) , U+0025 (PERCENT SIGN, %) , U+002F (SOLIDUS, FORWARD SLASH, /) , U+003F (QUESTION MARK, ?) , U+0023 (NUMBER SIGN, #) , U+002B (PLUS, +) , U+005B (LEFT SQUARE BRACKET, [) , and U+005D (RIGHT SQUARE BRACKET, ]) . That is “[#0-#20%/\?\#\+\[\]]”.

    Note:

    Encoding is performed unless the URI is known to be non-hierarchical; in other words, encoding is the default. This heuristic improves the reliability of using fn:build-uri() on the output of fn:parse-uri(). (For example, fn:parse-uri('a+b/c') => fn:build-uri() will return a+b/c.)

    It is necessary to avoid encoding non-hierarchical schemes because there is more variation in them (for example, the tel: scheme uses a “+” that must not be encoded). Users working with non-hierarchical schemes may need to address the encoding issue directly bearing in mind the encoding requirements of the particular schemes in use.

  • Otherwise the value of the path key is used.

  • If neither are present, the empty string is used for the path.

The path is added to the URI.

If the query-parameters key exists in the map, its value must be a map. A sequence of strings is constructed from the values in the map.

To construct the string, each key and value is encoded. The encoding performed replaces any control characters (codepoints less than 0x20) and exclusively the following characters with their percent-escaped forms: U+0020 (SPACE) , U+0025 (PERCENT SIGN, %) , U+003D (EQUALS SIGN, =) , U+0026 (AMPERSAND, &) , U+0023 (NUMBER SIGN, #) , U+002B (PLUS, +) , U+005B (LEFT SQUARE BRACKET, [) , and U+005D (RIGHT SQUARE BRACKET, ]) . That is “[#0-#20%=&\#\+\[\]]”. (This differs from the path encoding in that it excludes U+002F (SOLIDUS, FORWARD SLASH, /) and U+003F (QUESTION MARK, ?) but includes U+003D (EQUALS SIGN, =) and U+0026 (AMPERSAND, &) .) For each key and each value associated with that key in turn:

  • If the key is the empty string, the string constructed is the encoded value.

  • Otherwise, the string constructed is the value of the key, encoded, followed by an equal sign (U+003D (EQUALS SIGN, =) ), followed by the value, encoded.

The query is constructed by joining the resulting strings into a single string, separated by & (ampersand) characters. If the query-parameters key does not exist in the map, but the query key does, then the query is the value of the query key.

If there is a query, it is added to the URI with a preceding U+003F (QUESTION MARK, ?) .

If the fragment key exists in the map, then the value of that key is encoded and added to the URI with a preceding U+0023 (NUMBER SIGN, #) . The encoding performed replaces any control characters (codepoints less than 0x20) and exclusively the following characters with their percent-escaped forms: U+0020 (SPACE) , U+0025 (PERCENT SIGN, %) , U+0023 (NUMBER SIGN, #) , U+002B (PLUS, +) , U+005B (LEFT SQUARE BRACKET, [) , and U+005D (RIGHT SQUARE BRACKET, ]) . That is “[#0-#20%\#\+\[\]]”. (This differs from the path encoding in that it excludes U+002F (SOLIDUS, FORWARD SLASH, /) and U+003F (QUESTION MARK, ?) .)

The resulting URI is returned.

Examples
Expression:
build-uri({
  "scheme": "https",
  "host": "qt4cg.org",
  "port": (),
  "path": "/specifications/index.html"
})
Result:
"https://qt4cg.org/specifications/index.html"

9 Processing dates and times

This section defines operations on the [XML Schema Part 2: Datatypes Second Edition] date and time types.

See [Working With Timezones] for a disquisition on working with date and time values with and without timezones.

9.3 Constructing a dateTime

FunctionMeaning
fn:dateTimeReturns an xs:dateTime value created by combining an xs:date and an xs:time.
fn:unix-dateTimeReturns a dateTime value for a Unix time.

9.3.2 fn:unix-dateTime

Changes in 4.0 (next | previous)

  1. New in 4.0  [Issue 959 PR 1358 1 August 2024]

Summary

Returns a dateTime value for a Unix time.

Signature
fn:unix-dateTime(
$valueas xs:nonNegativeInteger?:= 0
) as xs:dateTimeStamp
Properties

This function is deterministic, context-independent, and focus-independent.

Rules

The function returns a dateTime value in UTC timezone for the Unix time specified by $value in milliseconds. If the value is absent or an empty sequence, 0 is used. The Unix time is defined in [IEEE 1003.1-2024].

If the implementation supports data types from XSD 1.1 then the returned value will be an instance of xs:dateTimeStamp. Otherwise, the only guarantees are that it will be an instance of xs:dateTime and will have a timezone component.

Formal Equivalent

The effect of the function is equivalent to the result of the following XPath expression.

xs:dateTime('1970-01-01T00:00:00Z') + ($value otherwise 0) * seconds(0.001)
Notes

By calling this convenience function, it can be ensured that the correct timezone is used for computing the Unix time.

Note that Unix time does not account for leap seconds. It assumes that every day has 86,400 seconds.

Examples
Expression:
unix-dateTime()
Result:
xs:dateTime('1970-01-01T00:00:00Z')
Expression:
unix-dateTime(1)
Result:
xs:dateTime('1970-01-01T00:00:00.001Z')
Expression:
unix-dateTime(86400000)
Result:
xs:dateTime('1970-01-02T00:00:00Z')

Calculate the Unix time associated with a xs:dateTime value:

let $value := current-dateTime()
return ($value - unix-dateTime()) div seconds(0.001)

9.6 Adjusting timezones on dates and times

FunctionMeaning
fn:adjust-dateTime-to-timezoneAdjusts an xs:dateTime value to a specific timezone, or to no timezone at all.
fn:adjust-date-to-timezoneAdjusts an xs:date value to a specific timezone, or to no timezone at all; the result is the date in the target timezone that contains the starting instant of the supplied date.
fn:adjust-time-to-timezoneAdjusts an xs:time value to a specific timezone, or to no timezone at all.
fn:civil-timezoneReturns the timezone offset from UTC that is in conventional use at a given place and time.

These functions adjust the timezone component of an xs:dateTime, xs:date or xs:time value. The $timezone argument to these functions is defined as an xs:dayTimeDuration but must be a valid timezone value.

9.6.1 fn:adjust-dateTime-to-timezone

Summary

Adjusts an xs:dateTime value to a specific timezone, or to no timezone at all.

Signature
fn:adjust-dateTime-to-timezone(
$valueas xs:dateTime?,
$timezoneas xs:dayTimeDuration?:= fn:implicit-timezone()
) as xs:dateTime?
Properties

The one-argument form of this function is deterministic, context-dependent, and focus-independent. It depends on implicit timezone.

The two-argument form of this function is deterministic, context-independent, and focus-independent.

Rules

If $timezone is not specified, then the effective value of $timezone is the value of the implicit timezone in the dynamic context.

If $value is the empty sequence, then the function returns the empty sequence.

If $value does not have a timezone component and $timezone is the empty sequence, then the result is $value.

If $value does not have a timezone component and $timezone is not the empty sequence, then the result is $value with $timezone as the timezone component.

If $value has a timezone component and $timezone is the empty sequence, then the result is the local value of $value without its timezone component.

If $value has a timezone component and $timezone is not the empty sequence, then the result is the xs:dateTime value that is equal to $value and that has a timezone component equal to $timezone.

Error Conditions

A dynamic error is raised [err:FODT0003] if $timezone is less than -PT14H or greater than PT14H or is not an integral number of minutes.

Examples
Variables
let $tz-10 := xs:dayTimeDuration("-PT10H")

Assume the dynamic context provides an implicit timezone of -05:00 (-PT5H0M).

Expression:
adjust-dateTime-to-timezone(
  xs:dateTime('2002-03-07T10:00:00')
)
Result:
xs:dateTime('2002-03-07T10:00:00-05:00')
Expression:
adjust-dateTime-to-timezone(
  xs:dateTime('2002-03-07T10:00:00-07:00')
)
Result:
xs:dateTime('2002-03-07T12:00:00-05:00')
Expression:
adjust-dateTime-to-timezone(
  xs:dateTime('2002-03-07T10:00:00'),
  $tz-10
)
Result:
xs:dateTime('2002-03-07T10:00:00-10:00')
Expression:
adjust-dateTime-to-timezone(
  xs:dateTime('2002-03-07T10:00:00-07:00'),
  $tz-10
)
Result:
xs:dateTime('2002-03-07T07:00:00-10:00')
Expression:
adjust-dateTime-to-timezone(
  xs:dateTime('2002-03-07T10:00:00-07:00'),
  xs:dayTimeDuration("PT10H")
)
Result:
xs:dateTime('2002-03-08T03:00:00+10:00')
Expression:
adjust-dateTime-to-timezone(
  xs:dateTime('2002-03-07T00:00:00+01:00'),
  xs:dayTimeDuration("-PT8H")
)
Result:
xs:dateTime('2002-03-06T15:00:00-08:00')
Expression:
adjust-dateTime-to-timezone(
  xs:dateTime('2002-03-07T10:00:00'),
  ()
)
Result:
xs:dateTime('2002-03-07T10:00:00')
Expression:
adjust-dateTime-to-timezone(
  xs:dateTime('2002-03-07T10:00:00-07:00'),
  ()
)
Result:
xs:dateTime('2002-03-07T10:00:00')

9.6.2 fn:adjust-date-to-timezone

Summary

Adjusts an xs:date value to a specific timezone, or to no timezone at all; the result is the date in the target timezone that contains the starting instant of the supplied date.

Signature
fn:adjust-date-to-timezone(
$valueas xs:date?,
$timezoneas xs:dayTimeDuration?:= fn:implicit-timezone()
) as xs:date?
Properties

The one-argument form of this function is deterministic, context-dependent, and focus-independent. It depends on implicit timezone.

The two-argument form of this function is deterministic, context-independent, and focus-independent.

Rules

If $timezone is not specified, then the effective value of $timezone is the value of the implicit timezone in the dynamic context.

If $value is the empty sequence, then the function returns the empty sequence.

If $value does not have a timezone component and $timezone is the empty sequence, then the result is $value.

If $value does not have a timezone component and $timezone is not the empty sequence, then the result is $value with $timezone as the timezone component.

If $value has a timezone component and $timezone is the empty sequence, then the result is the local value of $value without its timezone component.

If $value has a timezone component and $timezone is not the empty sequence, then:

  • Let $dt be the value of fn:dateTime($arg, xs:time('00:00:00')).

  • Let $adt be the value of fn:adjust-dateTime-to-timezone($dt, $timezone)

  • The function returns the value of xs:date($adt)

Error Conditions

A dynamic error is raised [err:FODT0003] if $timezone is less than -PT14H or greater than PT14H or is not an integral number of minutes.

Examples
Variables
let $tz-10 := xs:dayTimeDuration("-PT10H")
ExpressionResult

Assume the dynamic context provides an implicit timezone of -05:00 (-PT5H0M).

adjust-date-to-timezone(
  xs:date("2002-03-07")
)
xs:date("2002-03-07-05:00")
adjust-date-to-timezone(
  xs:date("2002-03-07-07:00")
)
xs:date("2002-03-07-05:00")

($value is converted to xs:dateTime("2002-03-07T00:00:00-07:00"). This is adjusted to the implicit timezone, giving "2002-03-07T02:00:00-05:00". ).

adjust-date-to-timezone(
  xs:date("2002-03-07"),
  $tz-10
)
xs:date("2002-03-07-10:00")
adjust-date-to-timezone(
  xs:date("2002-03-07-07:00"),
  $tz-10
)
xs:date("2002-03-06-10:00")

($value is converted to xs:dateTime("2002-03-07T00:00:00-07:00"). This is adjusted to the given timezone, giving "2002-03-06T21:00:00-10:00". ).

adjust-date-to-timezone(
  xs:date("2002-03-07"),
  ()
)
xs:date("2002-03-07")
adjust-date-to-timezone(
  xs:date("2002-03-07-07:00"),
  ()
)
xs:date("2002-03-07")

9.6.3 fn:adjust-time-to-timezone

Summary

Adjusts an xs:time value to a specific timezone, or to no timezone at all.

Signature
fn:adjust-time-to-timezone(
$valueas xs:time?,
$timezoneas xs:dayTimeDuration?:= fn:implicit-timezone()
) as xs:time?
Properties

The one-argument form of this function is deterministic, context-dependent, and focus-independent. It depends on implicit timezone.

The two-argument form of this function is deterministic, context-independent, and focus-independent.

Rules

If $timezone is not specified, then the effective value of $timezone is the value of the implicit timezone in the dynamic context.

If $value is the empty sequence, then the function returns the empty sequence.

If $value does not have a timezone component and $timezone is the empty sequence, then the result is $value.

If $value does not have a timezone component and $timezone is not the empty sequence, then the result is $value with $timezone as the timezone component.

If $value has a timezone component and $timezone is the empty sequence, then the result is the localized value of $value without its timezone component.

If $value has a timezone component and $timezone is not the empty sequence, then:

  • Let $dt be the xs:dateTime value fn:dateTime(xs:date('1972-12-31'), $value).

  • Let $adt be the value of fn:adjust-dateTime-to-timezone($dt, $timezone)

  • The function returns the xs:time value xs:time($adt).

Error Conditions

A dynamic error is raised [err:FODT0003] if $timezone is less than -PT14H or greater than PT14H or if does not contain an integral number of minutes.

Examples
Variables
let $tz-10 := xs:dayTimeDuration("-PT10H")
ExpressionResult

Assume the dynamic context provides an implicit timezone of -05:00 (-PT5H0M).

adjust-time-to-timezone(
  xs:time("10:00:00")
)
xs:time("10:00:00-05:00")
adjust-time-to-timezone(
  xs:time("10:00:00-07:00")
)
xs:time("12:00:00-05:00")
adjust-time-to-timezone(
  xs:time("10:00:00"),
  $tz-10
)
xs:time("10:00:00-10:00")
adjust-time-to-timezone(
  xs:time("10:00:00-07:00"),
  $tz-10
)
xs:time("07:00:00-10:00")
adjust-time-to-timezone(
  xs:time("10:00:00"),
  ()
)
xs:time("10:00:00")
adjust-time-to-timezone(
  xs:time("10:00:00-07:00"),
  ()
)
xs:time("10:00:00")
adjust-time-to-timezone(
  xs:time("10:00:00-07:00"),
  xs:dayTimeDuration("PT10H")
)
xs:time("03:00:00+10:00")

9.6.4 fn:civil-timezone

Changes in 4.0 (next | previous)

  1. New in 4.0  [Issue 1539 PR 1545 5 November 2024]

Summary

Returns the timezone offset from UTC that is in conventional use at a given place and time.

Signature
fn:civil-timezone(
$valueas xs:dateTime,
$placeas xs:string?:= ()
) as xs:dayTimeDuration
Properties

The one-argument form of this function is deterministic, context-dependent, and focus-independent. It depends on default place.

The two-argument form of this function is deterministic, context-independent, and focus-independent.

Rules

This function uses a database of civil timezones (including daylight savings time) to return the timezone offset for a given date/time and place. For example, the timezone offset for New York on 31 December 2024 would be -PT5H.

If the $place argument is omitted or empty then the default placeXP from the dynamic context is used.

If the supplied $value has no timezone then the implicit timezone from the dynamic context is used. This is unrelated to the timezone applicable to the requested $place.

The intended use of the $place argument is to identify the place where an event represented by the $value argument took place or will take place. The value must be an IANA timezone name as defined in the IANA timezone database [IANA Timezone Database]. Examples are "America/New_York" and "Europe/Rome".

The result of the function is the civil timezone offset applicable to the given date/time and place, as determined by the IANA timezone database or an alternative authoritative source.

Error Conditions

A dynamic error is raised [err:FODT0004] if no timezone information is available for the given date/time and place. This includes the case where the given place is not present in the timezone database, and also the case where the information available for that place does not cover a sufficient range of dates.

Examples
Expression:
civil-timezone(
  xs:dateTime('2024-12-31T23:59:59'), 'America/New_York')
Result:
xs:dayTimeDuration('-PT5H')
Expression:
civil-timezone(
  xs:dateTime('2024-06-30T23:59:59'), 'America/New_York')
Result:
xs:dayTimeDuration('-PT4H')

The expression:

adjust-dateTime-to-timezone(
  current-dateTime(),
  civil-timezone(current-dateTime(), 'America/New_York')
)

returns the current civil date and time in New York.

If the default place is a location in the same timezone as (say) Paris, then the expression

civil-timezone(xs:dateTime('2024-07-01T09:00:00'))

returns PT2H.

12 Processing nodes

12.1 Accessors

Accessors and their semantics are described in [XQuery and XPath Data Model (XDM) 4.0]. Some of these accessors are exposed to the user through the functions described below.

Each of these functions has an arity-zero signature which is equivalent to the arity-one form, with the context value supplied as the implicit first argument. In addition, each of the arity-one functions accepts an empty sequence as the argument, in which case it generally delivers an empty sequence as the result: the exception is fn:string, which delivers a zero-length string.

FunctionAccessorAcceptsReturns
fn:node-namenode-namenode (optional)xs:QName (optional)
fn:nillednillednode (optional)xs:boolean (optional)
fn:stringstring-valueitem (optional)xs:string
fn:datatyped-valuezero or more itemsa sequence of atomic items
fn:base-uribase-urinode (optional)xs:anyURI (optional)
fn:document-uridocument-urinode (optional)xs:anyURI (optional)
FunctionMeaning
fn:base-uriReturns the base URI of a node.
fn:document-uriReturns the URI of a resource where a document can be found, if available.
fn:nilledReturns true for an element that is nilled.
fn:node-nameReturns the name of a node, as an xs:QName.
fn:stringReturns the value of $value represented as an xs:string.
fn:dataReturns the result of atomizing a sequence. This process flattens arrays, and replaces nodes by their typed values.

12.1.1 fn:base-uri

Changes in 4.0 (next | previous)

  1. An error may now be raised if the base URI is not a valid LEIRI reference.  [Issue 2148 PR 2223 2 October 2025]

Summary

Returns the base URI of a node.

Signature
fn:base-uri(
$nodeas node()?:= .
) as xs:anyURI?
Properties

The zero-argument form of this function is deterministic, context-dependent, and focus-dependent.

The one-argument form of this function is deterministic, context-independent, and focus-independent.

Rules

The zero-argument version of the function returns the base URI of the context node: it is equivalent to calling fn:base-uri(.).

The single-argument version of the function behaves as follows:

  1. If $node is the empty sequence, the function returns the empty sequence.

  2. Otherwise, the function returns the value of the dm:base-uri accessor applied to the node $node. This accessor is defined, for each kind of node, in the XDM specification (See [XQuery and XPath Data Model (XDM) 4.0] section 7.6.2 base-uri Accessor).

If $node is the empty sequence, the function returns the empty sequence.

Otherwise, the function returns the value of the dm:base-uri accessor applied to the node $node. This accessor is defined, for each kind of node, in the XDM specification (See [XQuery and XPath Data Model (XDM) 4.0] section 7.6.2 base-uri Accessor).

Note:

As explained in XDM, document, element and processing-instruction nodes have a base-uri property which may be empty. The base-uri property for all other node kinds is the empty sequence. The dm:base-uri accessor returns the base-uri property of a node if it exists and is non-empty; otherwise it returns the result of applying the dm:base-uri accessor to its parent, recursively. If the node does not have a parent, or if the recursive ascent up the ancestor chain encounters a parentless node whose base-uri property is empty, the empty sequence is returned. In the case of namespace nodes, however, the result is always an empty sequence — it does not depend on the base URI of the parent element.

See also fn:static-base-uri.

Error Conditions

The following errors may be raised when $node is omitted:

  • If the context value is absentDM, type error [err:XPDY0002]XP

  • If the context value is not an instance of the sequence type node()?, type error [err:XPTY0004]XP.

A dynamic error may be raised [err:FORG0002] if the base URI is not a valid Legacy Extended IRI reference (see [Legacy extended IRIs for XML resource identification]).

12.1.2 fn:document-uri

Changes in 4.0 (next | previous)

  1. The constraints on the result of the function have been relaxed.  [Issues 898 1161 PR 1265 2 July 2024]

Summary

Returns the URI of a resource where a document can be found, if available.

Signature
fn:document-uri(
$nodeas node()?:= .
) as xs:anyURI?
Properties

The zero-argument form of this function is deterministic, context-dependent, and focus-dependent.

The one-argument form of this function is deterministic, context-independent, and focus-independent.

Rules

If the argument is omitted, it defaults to the context value (.).

If $node is the empty sequence, the function returns the empty sequence.

If $node is not a document node, the function returns the empty sequence.

Otherwise, the function returns the value of the document-uri accessor applied to $node, as defined in [XQuery and XPath Data Model (XDM) 3.1] (See [XQuery and XPath Data Model (XDM) 4.0] section 7.5.1.2 Accessors).

Error Conditions

The following errors may be raised when $node is omitted:

  • If the context value is absentDM, type error [err:XPDY0002]XP

  • If the context value is not an instance of the sequence type node()?, type error [err:XPTY0004]XP.

Notes

In the 3.1 version of this specification, it was mandated that two distinct documents could not have the same document-uri property: more specifically, it was guaranteed that for any document node $D, either document-uri($D) would be absent, or doc(document-uri($D)) would return $D.

For various reasons, this constraint has proved impractical. Different parts of an application may read the same external resource in different ways, for example with or without validation or whitespace stripping, leading to different document nodes derived from the same external resource having the same document-uri property. In addition, the specification explicitly allows implementations, at user request, to relax the requirements for determinism of resource access functions, which makes it possible for multiple calls of functions such as fn:doc, fn:json-doc, or fn:collection to return different results for the same supplied URI.

Although the uniqueness of the document-uri property is no longer an absolute constraint, it is still desirable that implementations should where possible respect the principle that URIs are usable as identifiers for resources.

In the case of a document node $D returned by the fn:doc function, it will generally be the case that fn:document-uri($D) returns a URI $U such that a call on fn:doc($U) in the same dynamic context will return the same document node $D. The URI $U will not necessarily be the same URI that was originally passed to the fn:doc function, since several URIs may identify the same resource.

It is recommended that implementations of fn:collection should ensure that any documents included in the returned collection, if they have a non-empty fn:document-uri property, should be such that a call on fn:doc supplying this URI returns the same document node.

12.1.3 fn:nilled

Summary

Returns true for an element that is nilled.

Signature
fn:nilled(
$nodeas node()?:= .
) as xs:boolean?
Properties

The zero-argument form of this function is deterministic, context-dependent, and focus-dependent.

The one-argument form of this function is deterministic, context-independent, and focus-independent.

Rules

If the argument is omitted, it defaults to the context value (.).

If $node is the empty sequence, the function returns the empty sequence.

Otherwise the function returns the result of the dm:nilled accessor as defined in [XQuery and XPath Data Model (XDM) 3.1] (see [XQuery and XPath Data Model (XDM) 4.0] section 7.6.8 nilled Accessor).

Error Conditions

The following errors may be raised when $node is omitted:

  • If the context value is absentDM, type error [err:XPDY0002]XP

  • If the context value is not an instance of the sequence type node()?, type error [err:XPTY0004]XP.

Notes

If $node is not an element node, the function returns the empty sequence.

If $node is an untyped element node, the function returns false.

In practice, the function returns true only for an element node that has the attribute xsi:nil="true" and that is successfully validated against a schema that defines the element to be nillable; the detailed rules, however, are defined in [XQuery and XPath Data Model (XDM) 3.1].

12.1.4 fn:node-name

Summary

Returns the name of a node, as an xs:QName.

Signature
fn:node-name(
$nodeas node()?:= .
) as xs:QName?
Properties

The zero-argument form of this function is deterministic, context-dependent, and focus-dependent.

The one-argument form of this function is deterministic, context-independent, and focus-independent.

Rules

If the argument is omitted, it defaults to the context value (.).

If $node is the empty sequence, the empty sequence is returned.

Otherwise, the function returns the result of the dm:node-name accessor as defined in [XQuery and XPath Data Model (XDM) 3.1] (see [XQuery and XPath Data Model (XDM) 4.0] section 7.6.10 node-name Accessor).

Error Conditions

The following errors may be raised when $node is omitted:

  • If the context value is absentDM, type error [err:XPDY0002]XP.

  • If the context value is not an instance of the sequence type node()?, type error [err:XPTY0004]XP.

Notes

For element and attribute nodes, the name of the node is returned as an xs:QName, retaining the prefix, namespace URI, and local part.

For processing instructions, the name of the node is returned as an xs:QName in which the prefix and namespace URI are absentDM.

For a namespace node, the function returns an empty sequence if the node represents the default namespace; otherwise it returns an xs:QName in which prefix and namespace URI are absentDM and the local part is the namespace prefix being bound.

For all other kinds of node, the function returns the empty sequence.

Examples
Variables
let $e := <doc>
  <p id="alpha" xml:id="beta">One</p>
  <p id="gamma" xmlns="http://example.com/ns">Two</p>
  <ex:p id="delta" xmlns:ex="http://example.com/ns">Three</ex:p>
  <?pi 3.14159?>
</doc>
ExpressionResult
node-name($e//*[@id = 'alpha'])

QName("", "p")

node-name($e//*[@id = 'gamma'])

QName("http://example.com/ns", "p")

node-name($e//*[@id = 'delta'])

QName("http://example.com/ns", "ex:p")

node-name($e//processing-instruction())

QName("", "pi")

node-name($e//*[@id = 'alpha']/text())

()

node-name($e//*[@id = 'alpha']/@id)

QName("", "id")

node-name($e//*[@id = 'alpha']/@xml:id)

#xml:id

12.1.5 fn:string

Summary

Returns the value of $value represented as an xs:string.

Signature
fn:string(
$valueas item()?:= .
) as xs:string
Properties

The zero-argument form of this function is deterministic, context-dependent, and focus-dependent.

The one-argument form of this function is deterministic, context-independent, and focus-independent.

Rules

In the zero-argument version of the function, $value defaults to the context value. That is, calling fn:string() is equivalent to calling fn:string(.).

If $value is the empty sequence, the function returns the zero-length string.

If $value is an XNodeDM, the function returns the string value of the node, as obtained using the dm:string-value accessor defined in [XQuery and XPath Data Model (XDM) 3.1] (see [XQuery and XPath Data Model (XDM) 4.0] section 7.6.12 string-value Accessor).

If $value is a JNodeDM, the function returns the result of string(jnode-content($value)). This will fail in the case where jnode-content($value) is a map or an array.

If $value is an atomic item, the function returns the result of the expression $value cast as xs:string (see 23 Casting).

In all other cases, a dynamic error occurs (see below).

Error Conditions

The following errors may be raised when $value is omitted:

  • If the context value is absentDM, type error [err:XPDY0002]XP.

  • If the context value is not an instance of the sequence type item()?, type error [err:XPTY0004]XP.

A type error is raised [err:FOTY0014] if $value is a function item (this includes maps and arrays).

Notes

Every node has a string value, even an element with element-only content (which has no typed value). Moreover, casting an atomic item to a string always succeeds. Functions, maps, and arrays have no string value, so these satisfy the type signature but cause failure. Applying the string function to a JNode succeeds if the JNode wraps a simple value such as a string, number, or boolean, or if it wraps an XNode, but it fails in the case where the JNode wraps a map or an array.

Examples
Variables
let $para := <para>There lived a <term author="Tolkien">hobbit</term>.</para>
ExpressionResult
string(23)

"23"

string(false())

"false"

string("Paris")

"Paris"

string((1, 2, 3))

Raises error XPTY0004.

string([ [ 1, 2 ], [ 3, 4 ] ])

Raises error FOTY0014.

string(abs#1)

Raises error FOTY0014.

string({"x": [10, 20, 30]} / x / *[3])

"30"

string($para)

"There lived a hobbit."

12.1.6 fn:data

Summary

Returns the result of atomizing a sequence. This process flattens arrays, and replaces nodes by their typed values.

Signature
fn:data(
$inputas item()*:= .
) as xs:anyAtomicType*
Properties

The zero-argument form of this function is deterministic, context-dependent, and focus-dependent.

The one-argument form of this function is deterministic, context-independent, and focus-independent.

Rules

If the argument is omitted, it defaults to the context value (.).

The result of fn:data is the sequence of atomic items produced by applying the following rules to each item in $input:

  • If the item is an atomic item, it is appended to the result sequence.

  • If the item is an XNodeDM, the typed value of the node is appended to the result sequence. The typed value is a sequence of zero or more atomic items: specifically, the result of the dm:typed-value accessor as defined in [XQuery and XPath Data Model (XDM) 3.1] (See [XQuery and XPath Data Model (XDM) 4.0] section 7.6.14 typed-value Accessor).

  • If the item is a JNodeDM, the atomized value of its ·content· property is appended to the result sequence.

  • If the item is an array, the result of applying fn:data to each member of the array, in order, is appended to the result sequence.

Error Conditions

A type error is raised [err:FOTY0012] if an item in the sequence $input is a node that does not have a typed value.

A type error is raised [err:FOTY0013] if an item in the sequence $input is a function item other than an array.

A type error is raised [err:XPDY0002]XP if $input is omitted and the context value is absentDM.

Notes

The process of applying the fn:data function to a sequence is referred to as atomization. In many cases an explicit call on fn:data is not required, because atomization is invoked implicitly when a node or sequence of nodes is supplied in a context where an atomic item or sequence of atomic items is required.

The result of atomizing an empty sequence is an empty sequence.

The result of atomizing an empty array is an empty sequence.

Examples
Variables
let $para := <para>There lived a <term author="Tolkien">hobbit</term>.</para>
ExpressionResult
data(123)

123

data((123, 456))

123, 456

data([ [ 1, 2 ], [ 3, 4 ] ])

1, 2, 3, 4

data($para)

xs:untypedAtomic("There lived a hobbit.")

data($para/term/@author)

xs:untypedAtomic("Tolkien")

data(abs#1)

Raises error FOTY0013.

12.2 Other properties of nodes

This section specifies further functions that return properties of nodes. Nodes are formally defined in 6 Nodes DM31.

FunctionMeaning
fn:has-childrenReturns true if the supplied GNode has one or more child nodes (of any kind).
fn:in-scope-namespacesReturns the in-scope namespaces of an element node, as a map.
fn:in-scope-prefixesReturns the prefixes of the in-scope namespaces for an element node.
fn:langThis function tests whether the language of $node, or the context value if the second argument is omitted, as specified by xml:lang attributes is the same as, or is a sublanguage of, the language specified by $language.
fn:local-nameReturns the local part of the name of $node as an xs:string that is either the zero-length string, or has the lexical form of an xs:NCName.
fn:nameReturns the name of a node, as an xs:string that is either the zero-length string, or has the lexical form of an xs:QName.
fn:namespace-uriReturns the namespace URI part of the name of $node, as an xs:anyURI value.
fn:namespace-uri-for-prefixReturns the namespace URI of one of the in-scope namespaces for $element, identified by its namespace prefix.
fn:pathReturns a path expression that can be used to select the supplied node relative to the root of its containing document.
fn:rootReturns the root of the tree to which $node belongs. The function can be applied both to XNodesDM and to JNodesDM.
fn:siblingsReturns the supplied GNode together with its siblings, in document order.

12.2.1 fn:has-children

Changes in 4.0 (next | previous)

  1. Generalized to work with JNodes as well as XNodes.  [Issue 2100 ]

Summary

Returns true if the supplied GNode has one or more child nodes (of any kind).

Signature
fn:has-children(
$nodeas gnode()?:= .
) as xs:boolean
Properties

The zero-argument form of this function is deterministic, context-dependent, and focus-dependent.

The one-argument form of this function is deterministic, context-independent, and focus-independent.

Rules

If the argument is omitted, it defaults to the context value (.).

Provided that the supplied argumentThe $node matches the expected type gnode()?, the result of the function call fn:has-children($node) is defined to be the same as the result of the expression fn:exists($node/child::gnode()).

Error Conditions

The following errors may be raised when $node is omitted:

  • If the context value is absentDM, type error [err:XPDY0002]XP

  • If the context value is not an instance of the sequence type gnode()?, type error [err:XPTY0004]XP.

Notes

If $node is an empty sequence the result is false.

The motivation for this function is to support streamed evaluation. According to the streaming rules in [XSL Transformations (XSLT) Version 4.0], the following construct is not streamable:

<xsl:if test="exists(row)">
  <ulist>
    <xsl:for-each select="row">
      <item><xsl:value-of select="."/></item>
    </xsl:for-each>
  </ulist>
</xsl:if>

This is because it makes two downward selections to read the child row elements. The use of fn:has-children in the xsl:if conditional is intended to circumvent this restriction.

Although the function was introduced to support streaming use cases, it has general utility as a convenience function.

If the supplied argument is a map or an array, it will automatically be coerced to a JNode.

Examples
Variables
let $e := <doc>
  <p id="alpha">One</p>
  <p/>
  <p>Three</p>
  <?pi 3.14159?>
</doc>
ExpressionResult
has-children($e)

true()

has-children($e//p[1])

true()

has-children($e//p[2])

false()

has-children($e//p[3])

true()

has-children($e//processing-instruction())

false()

has-children($e//p[1]/text())

false()

has-children($e//p[1]/@id)

false()

[1,2,3] => has-children()

true()

[] => has-children()

false()

12.2.4 fn:lang

Summary

This function tests whether the language of $node, or the context value if the second argument is omitted, as specified by xml:lang attributes is the same as, or is a sublanguage of, the language specified by $language.

Signature
fn:lang(
$languageas xs:string?,
$nodeas node():= .
) as xs:boolean
Properties

The one-argument form of this function is deterministic, context-dependent, and focus-dependent.

The two-argument form of this function is deterministic, context-independent, and focus-independent.

Rules

The behavior of the function if the second argument is omitted is exactly the same as if the context value (.) had been passed as the second argument.

The language of the argument $node, or the context value if the second argument is omitted, is is determined by the value of the xml:lang attribute on the node, or, if the node has no such attribute, by the value of the xml:lang attribute on the nearest ancestor of the node that has an xml:lang attribute. If there is no such ancestor, then the function returns false.

If $language is the empty sequence, it is interpreted as the zero-length string.

The relevant xml:lang attribute is determined by the value of the XPath expression:

(ancestor-or-self::*/@xml:lang)[last()]

If this expression returns an empty sequence, the function returns false.

Otherwise, the function returns true if and only if, based on a caseless default match as specified in section 3.13 of [The Unicode Standard], either:

  1. $language is equal to the string-value of the relevant xml:lang attribute, or

  2. $language is equal to some substring of the string-value of the relevant xml:lang attribute that starts at the start of the string-value and ends immediately before a hyphen, - (HYPHEN-MINUS, #x002D).

Error Conditions

The following errors may be raised when $node is omitted:

Examples

The expression fn:lang("en") would return true if the context node were any of the following four elements:

  • <para xml:lang="en"/>

  • <div xml:lang="en"><para>And now, and forever!</para></div>

  • <para xml:lang="EN"/>

  • <para xml:lang="en-us"/>

The expression fn:lang("fr") would return false if the context node were <para xml:lang="EN"/>

12.2.5 fn:local-name

Summary

Returns the local part of the name of $node as an xs:string that is either the zero-length string, or has the lexical form of an xs:NCName.

Signature
fn:local-name(
$nodeas node()?:= .
) as xs:string
Properties

The zero-argument form of this function is deterministic, context-dependent, and focus-dependent.

The one-argument form of this function is deterministic, context-independent, and focus-independent.

Rules

If the argument is omitted, it defaults to the context value (.).

If the argument is supplied and is the empty sequence, the function returns the zero-length string.

If the node identified by $node has no name (that is, if it is a document node, a comment, a text node, or a namespace node having no name), the function returns the zero-length string.

Otherwise, the function returns the local part of the expanded-QName of the node identified by $node, as determined by the dm:node-name accessor defined in [XQuery and XPath Data Model (XDM) 4.0] section 7.6.10 node-name Accessor. This will be an xs:string whose lexical form is an xs:NCName.

Error Conditions

The following errors may be raised when $node is omitted:

Examples
Variables
let $e := <doc>
  <p id="alpha" xml:id="beta">One</p>
  <p id="gamma" xmlns="http://example.com/ns">Two</p>
  <ex:p id="delta" xmlns:ex="http://example.com/ns">Three</ex:p>
  <?pi 3.14159?>
</doc>
ExpressionResult
local-name($e//*[@id = 'alpha'])

"p"

local-name($e//*[@id = 'gamma'])

"p"

local-name($e//*[@id = 'delta'])

"p"

local-name($e//processing-instruction())

"pi"

local-name($e//*[@id = 'alpha']/text())

""

local-name($e//*[@id = 'alpha']/@id)

"id"

local-name($e//*[@id = 'alpha']/@xml:id)

"id"

12.2.6 fn:name

Summary

Returns the name of a node, as an xs:string that is either the zero-length string, or has the lexical form of an xs:QName.

Signature
fn:name(
$nodeas node()?:= .
) as xs:string
Properties

The zero-argument form of this function is deterministic, context-dependent, and focus-dependent.

The one-argument form of this function is deterministic, context-independent, and focus-independent.

Rules

If the argument is omitted, it defaults to the context value (.).

If the argument is supplied and is the empty sequence, the function returns the zero-length string.

If the node identified by $node has no name (that is, if it is a document node, a comment, a text node, or a namespace node having no name), the function returns the zero-length string.

Otherwise, the function returns the value of the expression fn:string(fn:node-name($node)).

Error Conditions

The following errors may be raised when $node is omitted:

  • If the context value is absentDM, type error [err:XPDY0002]XP

  • If the context value is not an instance of the sequence type node()?, type error [err:XPTY0004]XP.

Notes

Because the result depends on the choice of namespace prefixes in the source document, it is not good practice to use the result of this function for anything other than display purposes. For example, the test name(.) = 'my:profile' will fail if the source document uses an unexpected namespace prefix. Such a test (assuming it relates to an element node) is better written as boolean(self::my:profile).

Examples
Variables
let $e := <doc>
  <p id="alpha" xml:id="beta">One</p>
  <p id="gamma" xmlns="http://example.com/ns">Two</p>
  <ex:p id="delta" xmlns:ex="http://example.com/ns">Three</ex:p>
  <?pi 3.14159?>
</doc>
ExpressionResult
name($e//*[@id = 'alpha'])

"p"

name($e//*[@id = 'gamma'])

"p"

name($e//*[@id = 'delta'])

"ex:p"

name($e//processing-instruction())

"pi"

name($e//*[@id = 'alpha']/text())

""

name($e//*[@id = 'alpha']/@id)

"id"

name($e//*[@id = 'alpha']/@xml:id)

"xml:id"

12.2.7 fn:namespace-uri

Summary

Returns the namespace URI part of the name of $node, as an xs:anyURI value.

Signature
fn:namespace-uri(
$nodeas node()?:= .
) as xs:anyURI
Properties

The zero-argument form of this function is deterministic, context-dependent, and focus-dependent.

The one-argument form of this function is deterministic, context-independent, and focus-independent.

Rules

If the argument is omitted, it defaults to the context node (.).

If the argument is the empty sequence, if the node identified by $node is neither an element nor an attribute node, or if it is an element or attribute node whose expanded-QName (as determined by the dm:node-name accessor in the [XQuery and XPath Data Model (XDM) 4.0] section 7.6.10 node-name Accessor) is in no namespace, then the function returns the zero-length xs:anyURI value.

Otherwise, the result will be the namespace URI part of the expanded-QName of the node identified by $node, as determined by the dm:node-name accessor defined in [XQuery and XPath Data Model (XDM) 4.0] section 7.6.10 node-name Accessor), returned as an xs:anyURI value.

Error Conditions

The following errors may be raised when $node is omitted:

  • If the context value is absentDM, type error [err:XPDY0002]XP

  • If the context value is not an instance of the sequence type node()?, type error [err:XPTY0004]XP.

Examples
Variables
let $e := <doc>
  <p id="alpha" xml:id="beta">One</p>
  <p id="gamma" xmlns="http://example.com/ns">Two</p>
  <ex:p id="delta" xmlns:ex="http://example.com/ns">Three</ex:p>
  <?pi 3.14159?>
</doc>
ExpressionResult
namespace-uri($e//*[@id = 'alpha'])

""

namespace-uri($e//*[@id = 'gamma'])

"http://example.com/ns"

namespace-uri($e//*[@id = 'delta'])

"http://example.com/ns"

namespace-uri($e//processing-instruction())

""

namespace-uri($e//*[@id = 'alpha']/text())

""

namespace-uri($e//*[@id = 'alpha']/@id)

""

namespace-uri($e//*[@id = 'alpha']/@xml:id)

"http://www.w3.org/XML/1998/namespace"

12.2.9 fn:path

Changes in 4.0 (next | previous)

  1. Options are added to customize the form of the output.  [Issues 332 1660 PRs 1620 1886 29 November 2024]

  2. The function is extended to handle JNodes.  [Issue 2100  5 August 2025]

Summary

Returns a path expression that can be used to select the supplied node relative to the root of its containing document.

Signature
fn:path(
$nodeas gnode()?:= .,
$optionsas map(*)?:= {}
) as xs:string?
Properties

The zero-argument form of this function is deterministic, context-dependent, and focus-dependent.

The one-argument form of this function is deterministic, context-independent, and focus-independent.

The two-argument form of this function is deterministic, context-independent, and focus-independent.

Rules

The behavior of the function if the $nodeargument is omitted is exactly the same as if the context value (.) had been passed as the argument.

If $node is the empty sequence, the function returns the empty sequence.

The $options argument, if present, defines additional parameters controlling how the output is formatted. The option parameter conventions apply. The options available are as follows:

record(
origin?as gnode()?,
lexical?as xs:boolean,
namespaces?as map((xs:NCName | enum('')), xs:anyURI)?,
indexes?as xs:boolean
)
KeyMeaning

origin?

A GNode, which must be an ancestor of $node. If present, the returned path will be a relative path that selects $node starting from the supplied origin node, rather than from the root of the containing tree.
  • Type: gnode()?

  • Default: ()

lexical?

If true, the names of element nodes in the path are represented by the result of a call on the name function applied to each element. The result in this case does not contain sufficient information to identify the namespace URI of the element.
  • Type: xs:boolean

  • Default: false

namespaces?

A map from namespace prefixes to namespace URIs, such as might be returned by the function fn:in-scope-namespaces. If a prefix is available for a given URI, it is used in preference to using Q{uri}local notation.
  • Type: map((xs:NCName | enum('')), xs:anyURI)?

  • Default: ()

indexes?

If true, the returned path includes the index positions of nodes. If false, only the node names are included.
  • Type: xs:boolean

  • Default: true

Let R be the GNode supplied in the origin option, or the root GNode of the tree containing $node otherwise.

If $node is a document node, or a JNode with no parent, the function returns the string "/".

Otherwise, the function returns a string that consists of a sequence of steps, one for each ancestor-or-self of $node that is not an ancestor-or-self of R.

If R is an XNode other than a document node and the origin option is absent or empty, then this string is preceded by a string notionally representing a call to the fn:root function, expressed as follows:

  • If the lexical option is present with the value true, then the string "fn:root()".

  • If the namespaces option is present and defines a mapping from a non empty prefix P to the namespace URI http://www.w3.org/2005/xpath-functions, then "P:root()"

  • If the namespaces option is present and defines a mapping from the empty string to the namespace URI http://www.w3.org/2005/xpath-functions, then "root()"

  • Otherwise, "Q{http://www.w3.org/2005/xpath-functions}root()".

Each step is the concatenation of:

  1. The character "/", which is omitted for the first step if the origin option is present;

  2. A string whose form depends on the kind of node selected by that step, as follows:

    1. For an element node, the concatenation of:

      1. A representation of the element name, chosen as follows:

        1. If the lexical option is present with the value true, then the result of applying the name function to the element node.

        2. Otherwise, if the namespaces option is present and the element is in a namespace U and the namespaces option includes a mapping from a prefix P to the namespace U, then the string P:L, where L is the local part of the element name. If there is more than one such prefix, then one of them is chosen arbitrarily.

        3. Otherwise, if the namespaces option is present and the element is in a namespace U and the namespaces option includes a mapping from the zero-length string to the namespace U, then the local part of the element name.

        4. Otherwise, if the namespaces option is present and the element is in no namespace and the namespaces option includes no mapping from the zero-length string to any namespace, then the local part of the element name.

        5. Otherwise, the string Q{U}L, where U is the namespace URI of the element name or the empty string if the element is in no namespace, and L is the local part of the element name.

      2. Unless the indexes option is present with the value false, a string in the form [position] where position is an integer representing the one-based position of the selected node among its like-named siblings.

    2. For an attribute node, the concatenation of:

      1. The character "@"

      2. If the lexical option is present with the value true, then the result of applying the name function to the attribute node.

      3. Otherwise, if the attribute node is in no namespace, the local part of the attribute name.

      4. Otherwise, if the namespaces option is present, and if it includes a mapping from a non-empty namespace prefix P to the namespace URI of the attribute, then a string in the form P:L, where L is the local part of the attribute name. If there is more than one such prefix, then one of them is chosen arbitrarily.

      5. Otherwise, the string Q{U}L, where U is the namespace URI of the attribute name, and L is the local part of the attribute name.

    3. For a text node: text()[position] where position is an integer representing the position of the selected node among its text node siblings.

      The suffix [position] is omitted if the indexes option is present with the value false.

    4. For a comment node: comment()[position] where position is an integer representing the position of the selected node among its comment node siblings.

      The suffix [position] is omitted if the indexes option is present with the value false.

    5. For a processing-instruction node: processing-instruction(local)[position] where local is the name of the processing instruction node and position is an integer representing the position of the selected node among its like-named processing-instruction node siblings.

      The suffix [position] is omitted if the indexes option is present with the value false.

    6. For a namespace node:

      1. If the namespace node has a name: namespace::prefix, where prefix is the local part of the name of the namespace node (which represents the namespace prefix).

      2. If the namespace node has no name (that is, if it represents the default namespace): namespace::*[Ulocal-name() = ""]

        Here Ulocal-name() represents a call on the function fn:local-name and is formatted using the same conventions as the call on fn:root described earlier.

    7. For a JNode where the ·content· property of the parent is an array, then as the string *[N] where N is the value of the ·selector· property.

    8. For any other JNode (including the case where the ·content· property of the parent is a map):

      1. If the value is an xs:string, xs:untypedAtomic, or xs:anyURI that is castable to xs:NCName, then the result of casting the value to xs:NCName.

      2. If the value is an xs:string, xs:untypedAtomic, or xs:anyURI that is not castable to xs:NCName, then then as the string get("S") where S is the string value.

      3. If the value is numeric, then as the string get(N) where N is the result of casting the numeric value to xs:string.

      4. If the value is an xs:QName, then as the string get(#Q{uri}local) where uri and local are the namespace URI and local name parts of the QName.

      5. If the value is an xs:boolean, then as the string get(true()) or get(false()).

      6. If the value is of any other type, then as the string get(xs:T("S")) where T is the local part of the most specific built-in atomic type of which the value is an instance, and S is the result of casting the value to xs:string.

      TODO: Better handling of the case where the parent is neither a map nor an array, for example where it is a sequence of several maps or several arrays. It's hard to provide a better path for these when there is no AxisStep for selecting within such values.

Error Conditions

The following errors may be raised when $node is omitted:

  • If the context value is absentDM, type error [err:XPDY0002]XP

  • If the context value is not an instance of the sequence type node()?, type error [err:XPTY0004]XP.

If the value of the origin option is a node that is not an ancestor of $node (or in the absence of $node, the context value), dynamic error [err:FOPA0001].

Notes

Using the namespaces option to shorten the generated path is often convenient, but the resulting path may be unusable if the input tree contains multiple bindings for the same prefix.

Similarly, using the lexical option is convenient if there is no need for precise namespace information: it is especially suitable when the containing node tree declares no namespaces.

If the supplied argument is a map or an array, it will automatically be coerced to a JNode. This however is not useful, because this will be a root JNode, yielding the path /.

Examples
Variables
let $e := document {            
  <p xmlns="http://example.com/one" xml:lang="de" author="Friedrich von Schiller">
Freude, schöner Götterfunken,<br/>
Tochter aus Elysium,<br/>
Wir betreten feuertrunken,<br/>
Himmlische, dein Heiligtum.
</p>}
let $emp := 
  <employee xml:id="ID21256">
     <empnr>E21256</empnr>
     <first>John</first>
     <last>Brown</last>
  </employee>
Expression:
path($e)
Result:
'/'
Expression:
path($e/*:p)
Result:
'/Q{http://example.com/one}p[1]'
Expression:
path($e/*:p, { 'namespaces': in-scope-namespaces($e/*) })
Result:
'/p[1]'
Expression:
path($e/*:p, { 'indexes': false() })
Result:
'/Q{http://example.com/one}p'
Expression:
path($e/*:p/@xml:lang)
Result:
'/Q{http://example.com/one}p[1]/@Q{http://www.w3.org/XML/1998/namespace}lang'
Expression:
path($e//@xml:lang, { 'namespaces': in-scope-namespaces($e/*) })
Result:
'/p[1]/@xml:lang'
Expression:
path($e/*:p/@author)
Result:
'/Q{http://example.com/one}p[1]/@author'
Expression:
path($e/*:p/*:br[2])
Result:
'/Q{http://example.com/one}p[1]/Q{http://example.com/one}br[2]'
Expression:
path($e/*:p/*:br[2], {
  'namespaces': { 'N': 'http://example.com/one' },
  'indexes': false() 
})
Result:
'/N:p/N:br'
Expression:
path($e//text()[starts-with(normalize-space(), 'Tochter')])
Result:
'/Q{http://example.com/one}p[1]/text()[2]'
Expression:
path($e/*:p/*:br[2], { 'lexical': true() })
Result:
'/p[1]/br[2]'
Expression:
path($e/*:p/*:br[2], { 'lexical': true(), 'origin': $e/*:p })
Result:
'br[2]'
Expression:
path($emp)
Result:
'Q{http://www.w3.org/2005/xpath-functions}root()'
Expression:
path($emp/@xml:id)
Result:
'Q{http://www.w3.org/2005/xpath-functions}root()/@Q{http://www.w3.org/XML/1998/namespace}id'
Expression:
path($emp/empnr)
Result:
'Q{http://www.w3.org/2005/xpath-functions}root()/Q{}empnr[1]'
Expression:
path($emp/empnr, { 'lexical': true() })
Result:
'fn:root()/empnr[1]'
Expression:
path($emp/empnr, {
  'namespaces': {
    'fn': 'http://www.w3.org/2005/xpath-functions',
    '': ''
  }
})
Result:
'fn:root()/empnr[1]'
Expression:
let $in := [{"b":[3,4]}]
return path($in/*[1]/b/*[2])
Result:
"/*[1]/b/*[2]"
Expression:
let $in := [[{'a':1}], [{'a':2}]]
return path($in//a[. = 2])
Result:
"/*[2]/*[1]/a"

12.2.10 fn:root

Summary

Returns the root of the tree to which $node belongs. The function can be applied both to XNodesDM and to JNodesDM.

Signature
fn:root(
$nodeas gnode()?:= .
) as gnode()?
Properties

The zero-argument form of this function is deterministic, context-dependent, and focus-dependent.

The one-argument form of this function is deterministic, context-independent, and focus-independent.

Rules

If the function is called without an argument, the context value (.) is used as the default argument.

The function returns the value of the expression $node/ancestor-or-self::gnode()[last()].

Error Conditions

The following errors may be raised when $node is omitted:

  • If the context value is absentDM, type error [err:XPDY0002]XP

  • If the context value is not an instance of the sequence type gnode()?, type error [err:XPTY0004]XP.

Examples

These examples use some variables which could be defined in [XQuery 4.0: An XML Query Language] as:

let $i := <tool>wrench</tool>
let $o := <order>{ $i }<quantity>5</quantity></order>
let $odoc := document { $o }
let $newi := $o/tool

Or they could be defined in [XSL Transformations (XSLT) Version 4.0] as:

<xsl:variable name="i" as="element()">
  <tool>wrench</tool>
</xsl:variable>

<xsl:variable name="o" as="element()">
  <order>
    <xsl:copy-of select="$i"/>
    <quantity>5</quantity>
  </order>
</xsl:variable>

<xsl:variable name="odoc">
  <xsl:copy-of select="$o"/>
</xsl:variable>

<xsl:variable name="newi" select="$o/tool"/>

root($i) returns the element node $i

root($o/quantity) returns the element node $o

root($odoc//quantity) returns the document node $odoc

root($newi) returns the element node $o

The final three examples could be made type-safe by wrapping their operands with exactly-one().

12.2.11 fn:siblings

Changes in 4.0 (next | previous)

  1. New in 4.0  [Issues 1542 1552 PRs 1547 1551]

Summary

Returns the supplied GNode together with its siblings, in document order.

Signature
fn:siblings(
$nodeas gnode()?:= .
) as gnode()*
Properties

The zero-argument form of this function is deterministic, context-dependent, and focus-dependent.

The one-argument form of this function is deterministic, context-independent, and focus-independent.

Rules

If the $node argument is omitted, it defaults to the context value (.).

If the value of $node is an empty sequence, the function returns an empty sequence.

If $node is a child of some parent GNode P, the function returns all the children of P (including $node), in document order, as determined by the value of $node/child::gnode().

Otherwise (specifically, if $node is parentless, or if it is an attribute or namespace node), the function returns $node.

Formal Equivalent

The effect of the function is equivalent to the result of the following XPath expression.

if ($node intersect $node/parent::node()/child::node())
then $node/parent::node()/child::node()
else $node
Error Conditions

The following errors may be raised when $node is omitted:

  • If the context value is absentDM, type error [err:XPDY0002]XP

  • If the context value is not an instance of the sequence type node()?, type error [err:XPTY0004]XP.

Notes

The result of siblings($n) (except in error cases) is the same as the result of $n/(preceding-sibling::node() | following-sibling-or-self::node()). It is also the same as $n/(preceding-sibling-or-self::node() | following-sibling::node())

As with names such as parent and child, the word sibling used here as a technical term is not a precise match to its use in describing human family relationships, but is chosen for convenience.

Examples
Variables
let $e := <doc x="X"><a>A</a>text<?pi 3.14159?></doc>
ExpressionResult
siblings($e//a) ! string()

"A", "text", "3.14159"

siblings($e//processing-instruction('pi')) ! string()

"A", "text", "3.14159"

siblings($e//@x) ! string()

"X"

12.4 Identifying nodes

This section defines a number of functions used to find elements by ID or IDREF value, or to generate identifiers.

FunctionMeaning
fn:idReturns the sequence of element nodes that have an ID value matching the value of one or more of the IDREF values supplied in $values.
fn:element-with-id Returns the sequence of element nodes that have an ID value matching the value of one or more of the IDREF values supplied in $values.
fn:idrefReturns the sequence of element or attribute nodes with an IDREF value matching the value of one or more of the ID values supplied in $values.
fn:generate-idThis function returns a string that uniquely identifies a given GNode.

12.4.1 fn:id

Summary

Returns the sequence of element nodes that have an ID value matching the value of one or more of the IDREF values supplied in $values.

Signature
fn:id(
$valuesas xs:string*,
$nodeas node():= .
) as element()*
Properties

The one-argument form of this function is deterministic, context-dependent, and focus-dependent.

The two-argument form of this function is deterministic, context-independent, and focus-independent.

Rules

The function returns a sequence, in document order with duplicates eliminated, containing every element node E that satisfies all the following conditions:

  1. E is in the target document. The target document is the document containing $node, or the document containing the context value (.) if the second argument is omitted. The behavior of the function if $node is omitted is exactly the same as if the context value had been passed as $node.

  2. E has an ID value equal to one of the candidate IDREF values, where:

    • An element has an ID value equal to V if either or both of the following conditions are true:

      • The is-id property (See [XQuery and XPath Data Model (XDM) 4.0] section 7.6.5 is-id Accessor.) of the element node is true, and the typed value of the element node is equal to V under the rules of the eq operator using the Unicode codepoint collation (http://www.w3.org/2005/xpath-functions/collation/codepoint).

      • The element has an attribute node whose is-id property (See [XQuery and XPath Data Model (XDM) 4.0] section 7.6.5 is-id Accessor.) is true and whose typed value is equal to V under the rules of the eq operator using the Unicode code point collation (http://www.w3.org/2005/xpath-functions/collation/codepoint).

    • Each xs:string in $values is parsed as if it were of type IDREFS, that is, each xs:string in $values is treated as a whitespace-separated sequence of tokens, each acting as an IDREF. These tokens are then included in the list of candidate IDREFs. If any of the tokens is not a lexically valid IDREF (that is, if it is not lexically an xs:NCName), it is ignored. Formally, the candidate IDREF values are the strings in the sequence given by the expression:

      for $s in $values
      return tokenize(normalize-space($s), ' ')[. castable as xs:IDREF]
  3. If several elements have the same ID value, then E is the one that is first in document order.

Error Conditions

A dynamic error is raised [err:FODC0001] if $node, or the context value if the second argument is absent, is a node in a tree whose root is not a document node.

The following errors may be raised when $node is omitted:

Notes

The effect of this function is anomalous in respect of element nodes with the is-id property. For legacy reasons, this function returns the element that has the is-id property, whereas it would be more appropriate to return its parent, that being the element that is uniquely identified by the ID. A new function fn:element-with-id has been introduced with the desired behavior.

If the data model is constructed from an Infoset, an attribute will have the is-id property if the corresponding attribute in the Infoset had an attribute type of ID: typically this means the attribute was declared as an ID in a DTD.

If the data model is constructed from a PSVI, an element or attribute will have the is-id property if its typed value is a single atomic item of type xs:ID or a type derived by restriction from xs:ID.

No error is raised in respect of a candidate IDREF value that does not match the ID of any element in the document. If no candidate IDREF value matches the ID value of any element, the function returns the empty sequence.

It is not necessary that the supplied argument should have type xs:IDREF or xs:IDREFS, or that it should be derived from a node with the is-idrefs property.

An element may have more than one ID value. This can occur with synthetic data models or with data models constructed from a PSVI where the element and one of its attributes are both typed as xs:ID.

If the source document is well-formed but not valid, it is possible for two or more elements to have the same ID value. In this situation, the function will select the first such element.

It is also possible in a well-formed but invalid document to have an element or attribute that has the is-id property but whose value does not conform to the lexical rules for the xs:ID type. Such a node will never be selected by this function.

Examples
Variables
let $emp := validate lax {
  document {
    <employee xml:id="ID21256"
              xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"  
              xmlns:xs="http://www.w3.org/2001/XMLSchema">
      <empnr xsi:type="xs:ID">E21256</empnr>
      <first>John</first>
      <last>Brown</last>
    </employee>
  }
}
ExpressionResult
$emp/id('ID21256')/name()
"employee"

(The xml:id attribute has the is-id property, so the employee element is selected.)

$emp/id('E21256')/name()
"empnr"

(Assuming the empnr element is given the type xs:ID as a result of schema validation, the element will have the is-id property and is therefore selected. Note the difference from the behavior of fn:element-with-id.)

12.4.2 fn:element-with-id

Summary

Returns the sequence of element nodes that have an ID value matching the value of one or more of the IDREF values supplied in $values.

Signature
fn:element-with-id(
$valuesas xs:string*,
$nodeas node():= .
) as element()*
Properties

The one-argument form of this function is deterministic, context-dependent, and focus-dependent.

The two-argument form of this function is deterministic, context-independent, and focus-independent.

Rules

Note:

The effect of this function is identical to fn:id in respect of elements that have an attribute with the is-id property. However, it behaves differently in respect of element nodes with the is-id property. Whereas the fn:id function, for legacy reasons, returns the element that has the is-id property, this function returns the element identified by the ID, which is the parent of the element having the is-id property.

The function returns a sequence, in document order with duplicates eliminated, containing every element node E that satisfies all the following conditions:

  1. E is in the target document. The target document is the document containing $node, or the document containing the context value (.) if the second argument is omitted. The behavior of the function if $node is omitted is exactly the same as if the context value had been passed as $node.

  2. E has an ID value equal to one of the candidate IDREF values, where:

    • An element has an ID value equal to V if either or both of the following conditions are true:

      • The element has an child element node whose is-id property (See [XQuery and XPath Data Model (XDM) 4.0] section 7.6.5 is-id Accessor.) is true and whose typed value is equal to V under the rules of the eq operator using the Unicode code point collation (http://www.w3.org/2005/xpath-functions/collation/codepoint).

      • The element has an attribute node whose is-id property (See [XQuery and XPath Data Model (XDM) 4.0] section 7.6.5 is-id Accessor.) is true and whose typed value is equal to V under the rules of the eq operator using the Unicode code point collation (http://www.w3.org/2005/xpath-functions/collation/codepoint).

    • Each xs:string in $values is parsed as if it were of type IDREFS, that is, each xs:string in $values is treated as a whitespace-separated sequence of tokens, each acting as an IDREF. These tokens are then included in the list of candidate IDREFs. If any of the tokens is not a lexically valid IDREF (that is, if it is not lexically an xs:NCName), it is ignored. Formally, the candidate IDREF values are the strings in the sequence given by the expression:

      for $s in $values
      return tokenize(normalize-space($s), ' ')[. castable as xs:IDREF]
  3. If several elements have the same ID value, then E is the one that is first in document order.

Error Conditions

A dynamic error is raised [err:FODC0001] if $node, or the context value if the second argument is omitted, is a node in a tree whose root is not a document node.

The following errors may be raised when $node is omitted:

Notes

This function is equivalent to the fn:id function except when dealing with ID-valued element nodes. Whereas the fn:id function selects the element containing the identifier, this function selects its parent.

If the data model is constructed from an Infoset, an attribute will have the is-id property if the corresponding attribute in the Infoset had an attribute type of ID: typically this means the attribute was declared as an ID in a DTD.

If the data model is constructed from a PSVI, an element or attribute will have the is-id property if its typed value is a single atomic item of type xs:ID or a type derived by restriction from xs:ID.

No error is raised in respect of a candidate IDREF value that does not match the ID of any element in the document. If no candidate IDREF value matches the ID value of any element, the function returns the empty sequence.

It is not necessary that the supplied argument should have type xs:IDREF or xs:IDREFS, or that it should be derived from a node with the is-idrefs property.

An element may have more than one ID value. This can occur with synthetic data models or with data models constructed from a PSVI where the element and one of its attributes are both typed as xs:ID.

If the source document is well-formed but not valid, it is possible for two or more elements to have the same ID value. In this situation, the function will select the first such element.

It is also possible in a well-formed but invalid document to have an element or attribute that has the is-id property but whose value does not conform to the lexical rules for the xs:ID type. Such a node will never be selected by this function.

Examples
Variables
let $emp := validate lax {    
  document {
    <employee xml:id="ID21256"
              xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"  
              xmlns:xs="http://www.w3.org/2001/XMLSchema">
      <empnr xsi:type="xs:ID">E21256</empnr>
      <first>John</first>
      <last>Brown</last>
    </employee>
  }
}
Expression:
$emp/element-with-id('ID21256')/name()
Result:
"employee"

(The xml:id attribute has the is-id property, so the employee element is selected.)

Expression:

$emp/element-with-id('E21256')/name()

Result:

"employee"

(Assuming the empnr element is given the type xs:ID as a result of schema validation, the element will have the is-id property and is therefore its parent is selected. Note the difference from the behavior of fn:id.)

12.4.3 fn:idref

Summary

Returns the sequence of element or attribute nodes with an IDREF value matching the value of one or more of the ID values supplied in $values.

Signature
fn:idref(
$valuesas xs:string*,
$nodeas node():= .
) as node()*
Properties

The one-argument form of this function is deterministic, context-dependent, and focus-dependent.

The two-argument form of this function is deterministic, context-independent, and focus-independent.

Rules

The function returns a sequence, in document order with duplicates eliminated, containing every element or attribute node $N that satisfies all the following conditions:

  1. $N is in the target document. The target document is the document containing $node, or the document containing the context value (.) if the second argument is omitted. The behavior of the function if $node is omitted is exactly the same as if the context value had been passed as $node.

  2. $N has an IDREF value equal to one of the candidate ID values, where:

    • A node $N has an IDREF value equal to V if both of the following conditions are true:

      • The is-idrefs property (see [XQuery and XPath Data Model (XDM) 4.0] section 7.6.6 is-idrefs Accessor) of $N is true.

      • The sequence

        tokenize(normalize-space(string($N)), ' ')

        contains a string that is equal to V under the rules of the eq operator using the Unicode code point collation (http://www.w3.org/2005/xpath-functions/collation/codepoint).

    • Each xs:string in $values is parsed as if it were of lexically of type xs:ID. These xs:strings are then included in the list of candidate xs:IDs. If any of the strings in $values is not a lexically valid xs:ID (that is, if it is not lexically an xs:NCName), it is ignored. More formally, the candidate ID values are the strings in the sequence:

      $values[. castable as xs:NCName]
Error Conditions

A dynamic error is raised [err:FODC0001] if $node, or the context value if the second argument is omitted, is a node in a tree whose root is not a document node.

The following errors may be raised when $node is omitted:

Notes

An element or attribute typically acquires the is-idrefs property by being validated against the schema type xs:IDREF or xs:IDREFS, or (for attributes only) by being described as of type IDREF or IDREFS in a DTD.

Because the function is sensitive to the way in which the data model is constructed, calls on this function are not always interoperable.

No error is raised in respect of a candidate ID value that does not match the IDREF value of any element or attribute in the document. If no candidate ID value matches the IDREF value of any element or attribute, the function returns the empty sequence.

It is possible for two or more nodes to have an IDREF value that matches a given candidate ID value. In this situation, the function will return all such nodes. However, each matching node will be returned at most once, regardless how many candidate ID values it matches.

It is possible in a well-formed but invalid document to have a node whose is-idrefs property is true but that does not conform to the lexical rules for the xs:IDREF type. The effect of the above rules is that ill-formed candidate ID values and ill-formed IDREF values are ignored.

If the data model is constructed from a PSVI, the typed value of a node that has the is-idrefs property will contain at least one atomic item of type xs:IDREF (or a type derived by restriction from xs:IDREF). It may also contain atomic items of other types. These atomic items are treated as candidate ID values if two conditions are met: their lexical form must be valid as an xs:NCName, and there must be at least one instance of xs:IDREF in the typed value of the node. If these conditions are not satisfied, such values are ignored.

Examples
Variables
let $emp := validate lax {  
  document {    
    <employees xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"  
               xmlns:xs="http://www.w3.org/2001/XMLSchema">  
      <employee xml:id="ID21256">
        <empnr xsi:type="xs:ID">E21256</empnr>
        <first>Anil</first>
        <last>Singh</last>
        <deputy xsi:type="xs:IDREF">E30561</deputy>
      </employee>
      <employee xml:id="ID30561">
        <empnr xsi:type="xs:ID">E30561</empnr>
        <first>John</first>
        <last>Brown</last>
        <manager xsi:type="xs:IDREF">ID21256</manager>
      </employee>
    </employees>
  }
}
Expression:
$emp/(
  element-with-id('ID21256')/@xml:id => idref()
)/ancestor::employee/last
=> string()
Result:
"Brown"

(Assuming that manager has the is-idref property, the call on fn:idref selects the manager element. If, instead, the manager had a ref attribute with the is-idref property, the call on fn:idref would select the attribute node.)

Expression:
$emp/(
  element-with-id('E30561')/empnr => idref()
)/ancestor::employee/last
=> string()
Result:
"Singh"

(Assuming that employee/deputy has the is-idref property, the call on fn:idref selects the deputy element.)

12.4.4 fn:generate-id

Summary

This function returns a string that uniquely identifies a given GNode.

Signature
fn:generate-id(
$nodeas gnode()?:= .
) as xs:string
Properties

The zero-argument form of this function is deterministic, context-dependent, and focus-dependent.

The one-argument form of this function is deterministic, context-independent, and focus-independent.

Rules

If the argument is omitted, it defaults to the context value (.).

If the argument is the empty sequence, the result is the zero-length string.

In other cases, the function returns a string that uniquely identifies a given node. More formally, it is guaranteed that within a single execution scope, fn:codepoint-equal(fn:generate-id($N), fn:generate-id($M)) returns true if and only if ($M is $N) returns true.

The returned identifier must consist of ASCII alphanumeric characters and must start with an alphabetic character. Thus, the string is syntactically an XML name.

Error Conditions

The following errors may be raised when $node is omitted:

  • If the context value is absentDM, type error [err:XPDY0002]XP

  • If the context value is not an instance of the sequence type gnode()?, type error [err:XPTY0004]XP.

Notes

An implementation is free to generate an identifier in any convenient way provided that it always generates the same identifier for the same GNode and that different identifiers are always generated from different GNodes. An implementation is under no obligation to generate the same identifiers each time a document is transformed or queried.

There is no guarantee that a generated unique identifier will be distinct from any unique IDs specified in the source document.

There is no inverse to this function; it is not directly possible to find the GNode with a given generated ID. Of course, it is possible to search a given sequence of GNodes using an expression such as $nodes[generate-id()=$id].

It is advisable, but not required, for implementations to generate IDs that are distinct even when compared using a case-blind collation.

Examples

The primary use case for this function is to generate hyperlinks. For example, when generating HTML, an anchor for a given section $sect can be generated by writing (in either XSLT or XQuery):

<a name="{ generate-id($sect) }"/>

and a link to that section can then be produced with code such as:

see <a href="#{ generate-id($sect) }">here</a>

Note that anchors generated in this way will not necessarily be the same each time a document is republished.

Since the keys in a map must be atomic items, it is possible to use generated IDs as surrogates for nodes when constructing a map. For example, in some implementations, testing whether a node $N is a member of a large node-set $S using the expression exists($N intersect $S) may be expensive; there may then be performance benefits in creating a map:

let $SMap := map:merge($S ! { generate-id(.) : . })

and then testing for membership of the node-set using:

map:contains($SMap, generate-id($N))

14 Processing maps

Maps were introduced as a new datatype in XDM 3.1. This section describes functions that operate on maps.

A map is a kind of item.

[Definition] A map consists of a sequence of entries, also known as key-value pairs. Each entry comprises a key which is an arbitrary atomic item, and an arbitrary sequence called the associated value.

[Definition] Within a map, no two entries have the same key. Two atomic items K1 and K2 are the same key for this purpose if the function call fn:atomic-equal($K1, $K2) returns true.

It is not necessary that all the keys in a map should be of the same type (for example, they can include a mixture of integers and strings).

Maps are immutable, and have no identity separate from their content. For example, the map:remove function returns a map that differs from the supplied map by the omission (typically) of one entry, but the supplied map is not changed by the operation. Two calls on map:remove with the same arguments return maps that are indistinguishable from each other; there is no way of asking whether these are “the same map”.

A map can also be viewed as a function from keys to associated values. To achieve this, a map is also a function item. The function corresponding to the map has the signature function($key as xs:anyAtomicValue) as item()*. Calling the function has the same effect as calling the map:get function: the expression $map($key) returns the same result as get($map, $key). For example, if $books-by-isbn is a map whose keys are ISBNs and whose assocated values are book elements, then the expression $books-by-isbn("0470192747") returns the book element with the given ISBN. The fact that a map is a function item allows it to be passed as an argument to higher-order functions that expect a function item as one of their arguments.

14.4 Functions that operate on maps

The functions defined in this section use a conventional namespace prefix map, which is assumed to be bound to the namespace URI http://www.w3.org/2005/xpath-functions/map.

The function call map:get($map, $key) can be used to retrieve the value associated with a given key.

There is no operation to atomize a map or convert it to a string. The function fn:serialize can in some cases be used to produce a JSON representation of a map.

Note that when the required type of an argument to a function such as map:build is a map type, then the coercion rules ensure that a JNode can be supplied in the function call: if the ·content· property of the JNode is a map, then the map is automatically extracted as if by the jnode-content function.

FunctionMeaning
map:buildReturns a map that typically contains one entry for each item in a supplied input sequence.
map:containsTests whether a supplied map contains an entry for a given key.
map:emptyReturns true if the supplied map contains no entries.
map:entriesReturns a sequence containing all the key-value pairs present in a map, each represented as a single-entry map.
map:entryReturns a single-entry map that represents a single key-value pair.
map:filterSelects entries from a map, returning a new map.
map:findSearches the supplied input sequence and any contained maps and arrays for a map entry with the supplied key, and returns the corresponding values.
map:for-eachApplies a supplied function to every entry in a map, returning the sequence concatenationXP of the results.
map:getReturns the value associated with a supplied key in a given map.
map:itemsReturns a sequence containing all the values present in a map, in order.
map:keysReturns a sequence containing all the keys present in a map.
map:keys-whereReturns a sequence containing selected keys present in a map.
map:mergeReturns a map that combines the entries from a number of existing maps.
map:putReturns a map containing all the contents of the supplied map, but with an additional entry, which replaces any existing entry for the same key.
map:removeReturns a map containing all the entries from a supplied map, except those having a specified key.
map:sizeReturns the number of entries in the supplied map.

14.4.1 map:build

Changes in 4.0 (next | previous)

  1. New in 4.0  [Issue 151 PR 203 18 October 2022]

Summary

Returns a map that typically contains one entry for each item in a supplied input sequence.

Signature
map:build(
$inputas item()*,
$keyas (fn($item as item(), $position as xs:integer) as xs:anyAtomicType*)?:= fn:identity#1,
$valueas (fn($item as item(), $position as xs:integer) as item()*)?:= fn:identity#1,
$optionsas map(*)?:= {}
) as map(*)
Properties

This function is deterministic, context-independent, and focus-independent.

Rules

Informally, the function processes each item in $input in order. It calls the $key function on that item to obtain a sequence of key values, and the $value function to obtain an associated value. Then, for each key value:

  • If the key is not already present in the target map, the processor adds a new key-value pair to the map, with that key and that value.

  • If the key is already present, the processor combines the new value for the key with the existing value; the way they are combined is determined by the duplicates option.

    By default, when two duplicate entries occur:

    • A single combined entry will be present in the result.

    • This entry will contain the sequence concatenationXP of the supplied values.

    • The position of the combined entry in the entry orderDM of the result map will correspond to the position of the first of the duplicates.

    • The key of the combined entry will correspond to the key of one of the duplicates: it is implementation-dependent which one is chosen. (It is possible for two keys to be considered duplicates even if they differ: for example, they may have different type annotations, or they may be xs:dateTime values in different timezones.)

    The $options argument can be used to control the way in which duplicate keys are handled. The option parameter conventions apply. The entries that may appear in the $options map are as follows:

    record(
    duplicates?as (enum( "reject", "use-first", "use-last", "use-any", "combine") | fn(item()*, item()*) as item()*)?
    )
    KeyValueMeaning

    duplicates?

    Determines the policy for handling duplicate keys: specifically, the action to be taken if two entries in the input sequence have key values K1 and K2 where K1 and K2 are the same key.
    • Type: (enum( "reject", "use-first", "use-last", "use-any", "combine") | fn(item()*, item()*) as item()*)?

    • Default: "combine"

    "reject" Equivalent to supplying a function that raises a dynamic error with error code "FOJS0003". The effect is that duplicate keys result in an error.
    "use-first"Equivalent to supplying the function fn($a, $b){ $a }. The effect is that the first of the duplicates is chosen.
    "use-last"Equivalent to supplying the function fn($a, $b){ $b }. The effect is that the last of the duplicates is chosen.
    "use-any"Equivalent to supplying the function fn($a, $b){ one-of($a, $b) } where one-of chooses either $a or $b in an implementation-dependent way. The effect is that it is implementation-dependent which of the duplicates is chosen.
    "combine"Equivalent to supplying the function fn($a, $b){ $a, $b } (or equivalently, the function op(",")). The effect is that the result contains the sequence concatenationXP of the values having the same key, retaining order.
    function(*) A function with signature fn(item()*, item()*) as item()*. The function is called for any entry in the input sequence that has the same key as a previous entry. The first argument is the existing value associated with the key; the second argument is the value associated with the key in the duplicate input entry, and the result is the new value to be associated with the key. The effect is cumulative: for example if there are three values X, Y, and Z associated with the same key, and the supplied function is F, then the result is an entry whose value is X => F(Y) => F(Z).
Formal Equivalent

The effect of the function is equivalent to the result of the following XPath expression.

for-each(
  $input, 
  fn($item, $pos) {
    for-each($key($item, $pos), fn($k) {
      map:entry($k, $value($item, $pos))
    }
  )}
)
=> map:merge($options)
Error Conditions

An error is raised [err:FOJS0003] if the value of $options indicates that duplicates are to be rejected, and a duplicate key is encountered.

An error is raised [err:FOJS0005] if the value of $options includes an entry whose key is defined in this specification, and whose value is not a permitted value for that key.

Notes

The default function for both $key and $value is the identity function. Although it is permitted to default both, this serves little purpose: usually at least one of these arguments will be supplied.

Examples
Expression:

map:build((), string#1)

Result:

{}

Expression:

map:build(1 to 10, fn { . mod 3 })

Result:

{ 0: (3, 6, 9), 1: (1, 4, 7, 10), 2: (2, 5, 8) }

(Returns a map with one entry for each distinct value of . mod 3. The function to compute the value is the identity function, and duplicates are combined by sequence concatenation.)

Expression:
map:build(
  1 to 5,
  value := format-integer(?, "w")
)
Result:
{ 1: "one", 2: "two", 3: "three", 4: "four", 5: "five" }

(Returns a map with five entries. The function to compute the key is an identity function, the function to compute the value invokes fn:format-integer.)

Expression:
map:build(
  ("January", "February", "March", "April", "May", "June",
   "July", "August", "September", "October", "November", "December"),
  substring(?, 1, 1)
)
Result:
{
  "A": ("April", "August"),
  "D": ("December"),
  "F": ("February"),
  "J": ("January", "June", "July"),
  "M": ("March", "May"),
  "N": ("November"),
  "O": ("October"),
  "S": ("September")
}
Expression:
map:build(1 to 5, {
  1: ("eins", "one"),
  4: ("vier", "four")
})
Result:
{
  "eins": 1,
  "one": 1,
  "vier": 4,
  "four": 4
}
Expression:
map:build(
  ("apple", "apricot", "banana", "blueberry", "cherry"), 
  substring(?, 1, 1),
  string-length#1,
  { "duplicates": op("+") }
)
Result:
{ "a": 12, "b": 15, "c": 6 }

(Constructs a map where the key is the first character of an input item, and where the corresponding value is the total string-length of the items starting with that character.)

Expression:
map:build(
  ('Wang', 'Liu', 'Zhao'),
  key := fn($name, $pos) { $name },
  value := fn($name, $pos) { $pos }
)
Result:
{ "Wang": 1, "Liu": 2, "Zhao": 3 }

(Returns an inverted index for the input sequence with the string stored as key and the position stored as value.)

Expression:
let $titles := <titles>
  <title>A Beginner’s Guide to <ix>Java</ix></title>
  <title>Learning <ix>XML</ix></title>
  <title>Using <ix>XML</ix> with <ix>Java</ix></title>
</titles>
return map:build($titles/title, fn($title) { $title/ix })
Result:
{
  "Java": (
    <title>A Beginner’s Guide to <ix>Java</ix></title>,
    <title>Using <ix>XML</ix> with <ix>Java</ix></title>
  ),
  "XML": (
    <title>Learning <ix>XML</ix></title>,
    <title>Using <ix>XML</ix> with <ix>Java</ix></title>
  )
}

The following expression creates a map whose keys are employee @ssn values, and whose corresponding values are the employee nodes:

map:build(//employee, fn { @ssn })

The following expression creates a map whose keys are employee @location values, and whose corresponding values represent the number of employees at each distinct location. Any employees that lack an @location attribute will be excluded from the result.

map:build(//employee, fn { @location }, fn { 1 }, { "duplicates": op("+") })

The following expression creates a map whose keys are employee @location values, and whose corresponding values contain the employee node for the highest-paid employee at each distinct location:

map:build(
  //employee,
  key := fn { @location }, 
  combine := fn($a, $b) { highest(($a, $b), fn { xs:decimal(@salary) }) }
)

The following expression creates a map allowing efficient access to every element in a document by means of its fn:generate-id value:

map:build(//*, generate-id#1)

The following expression creates a map allowing efficient access to values in a recursive JSON structure using hierarchic paths:

let $tree := parse-json('{
  "type": "package",
  "name": "org",
  "content": [
      { "type": "package",
        "name": "xml,
        "content: [
            { "type": "package",
              "name": "sax",
              "content": [
                  { "type": "class",
                    "name": "Attributes"},
                  { "type": "class",
                    "name": "ContentHandler"},
                  { "type": "class",
                    "name": "XMLReader"}
               ]
            }]
       }]
   }')
   return map:build($tree ? descendant::~[record(type, name, *)],
                    fn{?ancestor-or-self::name => reverse() => string-join(,)},
                    fn{`{?type} {?name}`})

The result is the map:

{ "org.xml.sax.Attributes": "class Attributes",
  "org.xml.sax.ContentHandler": "class ContentHandler",
  "org.xml.sax.XMLReader": "class XMLReader" }

14.4.9 map:get

Changes in 4.0 (next | previous)

  1. A third argument is added, allowing user control of how absent keys should be handled.  [Issue 1363 PRs 289 1901]

Summary

Returns the value associated with a supplied key in a given map.

Signature
map:get(
$mapas map(*),
$keyas xs:anyAtomicType,
$defaultas item()*:= ()
) as item()*
Properties

This function is deterministic, context-independent, and focus-independent.

Rules

The function map:get attempts to find an entry within the map supplied as $map that has the same key as $key. If there is such an entry, it returns the associated value; if not, it returns the supplied $default value, which defaults to the empty sequence.

Formal Equivalent

The function is defined as follows, making use of primitive constructors and accessors defined in [XQuery and XPath Data Model (XDM) 4.0].

let $entry := dm:iterate-map($map, fn($k, $v) {
  if (atomic-equal($k, $key)) {
    map:entry($k, $v)
  }
})
return (
  if (exists($entry))
  then map:items($entry)
  else $default
)
Notes

A return value of () from map:get#2 could indicate that the key is present in the map with an associated value of (), or it could indicate that the key is not present in the map. The two cases can be distinguished by either by calling map:contains to test whether an entry is present, or by using a $default value to return a value known never to appear in the map.

Invoking the map as a function item has the same effect as calling get with no $default argument: that is, when $map is a map, the expression $map($K) is equivalent to map:get($map, $K). Similarly, the expression map:get(map:get(map:get($map, 'employee'), 'name'), 'first') can be written as $map('employee')('name')('first').

Examples
Variables
let $week := {
  0: "Sonntag", 1: "Montag", 2: "Dienstag", 3: "Mittwoch",
  4: "Donnerstag", 5: "Freitag", 6: "Samstag"
}
ExpressionResult
map:get($week, 4)

"Donnerstag"

map:get($week, 9)

()

(When the key is not present, the function returns an empty sequence.)

map:get(map:entry(7,()), 7)

()

(An empty sequence as the result can also signify that the key is present and the associated value is an empty sequence.)

map:get($week, 7, "n/a")

"n/a"

(The third argument supplies a default value.)

14.4.13 map:merge

Changes in 4.0 (next | previous)

  1. For consistency with the new function map:build, the handling of duplicates may now be controlled by supplying a user-defined callback function as an alternative to the fixed values for the earlier duplicates option.  [Issue 1725 PR 1727 31 January 2025]

Summary

Returns a map that combines the entries from a number of existing maps.

Signature
map:merge(
$mapsas map(*)*,
$optionsas map(*)?:= {}
) as map(*)
Properties

This function is deterministic, context-independent, and focus-independent.

Rules

The function map:merge returns a map that is formed by combining the contents of the maps supplied in the $maps argument.

Informally, the supplied maps are combined as follows:

  1. There is one entry in the returned map for each distinct key present in the union of the input maps, where two keys are distinct if they are not the same key. The order of the input maps, and of the entries within these input maps, is retained in the entry orderDM of the result map.

  2. If there are duplicate keys, that is, if two or more maps contain entries having the same key, then the relevant entries are combined in a way that is controlled by the supplied $options.

    The $options argument takes the same values (with the same meanings) as the map:build function, except that the default is different: for map:merge, the default for duplicate keys is use-first.

    Note:

    The difference is for backwards compatibility reasons.

    With the default options, when duplicate entries occur:

    1. There will be a single entry in the result corresponding to a set of duplicate entries in the input.

    2. The value of that entry will be taken from the first of the duplicates.

    3. The position of that entry in the entry orderDM of the result map will correspond to the position of the first of the duplicates.

    4. The key of the combined entry will correspond to the key of one of the duplicates: it is implementation-dependent which one is chosen. (Keys may be duplicates even though they differ: for example, they may have different type annotations, or they may be xs:dateTime values in different timezones.)

Error Conditions

An error is raised [err:FOJS0003] if the value of $options indicates that duplicates are to be rejected, and a duplicate key is encountered.

An error is raised [err:FOJS0005] if the value of $options includes an entry whose key is defined in this specification, and whose value is not a permitted value for that key.

Notes

If the input is an empty sequence, the result is an empty map.

If the input is a sequence of length one, the result map is indistinguishable from the input map.

There is no requirement that the supplied input maps should have the same or compatible types. The type of a map (for example map(xs:integer, xs:string)) is descriptive of the entries it currently contains, but is not a constraint on how the map may be combined with other maps.

The XSLT 3.0 recommendation included a specification of this function that incorrectly used the option value { 'duplicates': 'unspecified' } in place of { 'duplicates': 'use-any' }. XSLT implementations wishing to preserve backwards compatibility may choose to retain support for this setting.

Examples
Variables
let $week := {
  0: "Sonntag", 1: "Montag", 2: "Dienstag", 3: "Mittwoch",
  4: "Donnerstag", 5: "Freitag", 6: "Samstag"
}
Expression:

map:merge(())

Result:

{}

(Returns an empty map).

Expression:
map:merge((
  map:entry(0, "no"),
  map:entry(1, "yes")
))
Result:
{ 0: "no", 1: "yes" }

(Returns a map with two entries).

Expression:
map:merge(({ "red": 0 }, { "green": 1}, { "blue": 2 })) 
=> map:keys()
Result:
"red", "green", "blue"

(Note the order of the result.)

Expression:
map:merge(
  ($week, { 7: "Unbekannt" })
)
Result:
{ 0: "Sonntag", 1: "Montag", 2: "Dienstag", 3: "Mittwoch",
  4: "Donnerstag", 5: "Freitag", 6: "Samstag", 7: "Unbekannt" }

(The value of the existing map is unchanged; the returned map contains all the entries from $week, supplemented with an additional entry.)

Expression:
map:merge(
  ($week, { 6: "Sonnabend" }),
  { "duplicates": "use-last" }
)
Result:
{ 0: "Sonntag", 1: "Montag", 2: "Dienstag", 3: "Mittwoch",
  4: "Donnerstag", 5: "Freitag", 6: "Sonnabend" }

(The value of the existing map is unchanged; the returned map contains all the entries from $week, with one entry replaced by a new entry. Both input maps contain an entry with the key 6; the one used in the result is the one that comes last in the input sequence.)

Expression:
map:merge(
  ($week, { 6: "Sonnabend" }),
  { "duplicates": "use-first" }
)
Result:
{ 0: "Sonntag", 1: "Montag", 2: "Dienstag", 3: "Mittwoch",
  4: "Donnerstag", 5: "Freitag", 6: "Samstag" }

(The value of the existing map is unchanged; the returned map contains all the entries from $week, with one entry replaced by a new entry. Both input maps contain an entry with the key 6; the one used in the result is the one that comes first in the input sequence.)

Expression:
map:merge(
  ($week, { 6: "Sonnabend" }),
  { "duplicates": "combine" }
)
Result:
{ 0: "Sonntag", 1: "Montag", 2: "Dienstag", 3: "Mittwoch",
  4: "Donnerstag", 5: "Freitag", 6: ("Samstag", "Sonnabend") }

(The value of the existing map is unchanged; the returned map contains all the entries from $week, with one entry replaced by a new entry. Both input maps contain an entry with the key 6; the entry that appears in the result is the sequence concatenationXP of the entries in the input maps, retaining order.)

Expression:
map:merge(
  ({ "oxygen": 0.22, "hydrogen": 0.68, "nitrogen": 0.1 },
   { "oxygen": 0.24, "hydrogen": 0.70, "nitrogen": 0.06 }), 
  { "duplicates": fn($a, $b) { max(($a, $b)) } })
Result:
{ "oxygen": 0.24, "hydrogen": 0.70, "nitrogen": 0.1 }

(The result map holds, for each distinct key, the maximum of the values for that key in the input.)

14.5 Converting elements to maps

Changes in 4.0 (next | previous)

  1. A new function fn:element-to-map is provided for converting XDM trees to maps suitable for serialization as JSON. Unlike the fn:xml-to-json function retained from 3.1, this can handle arbitrary XML as input.   [Issues 528 1645 1646 1647 1648 1658 1658 1797 PRs 1575 1906 19 November 2024]

The fn:element-to-map function converts a tree rooted at an XML element node to a corresponding tree of maps, in a form suitable for serialization as JSON. In effect it provides a mechanism for converting XML to JSON.

This section describes the mappings used by this function.

This mapping is designed with three objectives:

  • It should be possible to represent any XML element as a map suitable for JSON serialization.

  • The resulting JSON should be intuitive and easy to use.

  • The JSON should be consistent and stable: small variations in the input should not result in large variations in the output.

Achieving all three objectives requires design compromises. It also requires sacrificing some other desiderata. In consequence:

  • The conversion is not lossless (see 14.5.8 Lost XDM Information for details).

  • The conversion is not streamable.

  • The results are not necessarily compatible with those produced by other popular libraries.

The requirement for consistency and stability is particularly challenging. An element such as <name>John</name> maps naturally to the map { "name": "John" }; but adding an attribute (so it becomes <name role="first">John</name>) then requires an incompatible change in the JSON representation. The format could be made extensible by converting <name>John</name> to { "name": {"#content":"John"} } and <name role="first">John</name> to { "name": { "@role":"first", "#content":"John" } }, but this imposes unwanted complexity on the simplest cases. The solution adopted is threefold:

  • It is possible to analyze a corpus of XML documents to develop a conversion plan, which can then be applied consistently to individual input documents, whether or not these documents were present in the corpus. The conversion plan can be serialized and subsequently reused, so that it can be applied to input documents that might not have existed at the time the conversion plan was formulated.

  • Alternatively, the function can make use of schema information where available, so it considers not just the structure of an individual element instance, but the rules governing the element type.

  • It is possible to override the choices made by the system, and explicitly specify the format to be used for elements or attributes having a given name.

14.5.11 fn:element-to-map

Changes in 4.0 (next | previous)

  1. New in 4.0.  [ PR 1906]

Summary

Converts an element node into a map that is suitable for JSON serialization.

Signature
fn:element-to-map(
$elementas element()?,
$optionsas map(*)?:= {}
) as map(xs:string, item()?)?
Properties

This function is deterministic, context-independent, and focus-independent.

Rules

This function returns a map derived from the element node supplied in $element. The map is in a form that is suitable for JSON serialization, thus providing a mechanism for conversion of arbitrary XML to JSON.

The map that is returned will always be a single-entry map; the key of this entry will be a string representing the element name, and the value of the entry will be a representation of the element's attributes and children.

The entries that may appear in the $options map are as follows. The option parameter conventions apply.

record(
plan?as map(xs:string, record(layout?, child?, type?, *)),
attribute-marker?as xs:string,
name-format?as xs:string
)
KeyValueMeaning

plan?

A conversion plan, supplied as a map whose keys represent element and attribute names. The plan might be generated using the function element-to-map-plan, or it might be constructed in some other way. The format of the plan is described in 14.5.2 Creating a conversion plan.
  • Type: map(xs:string, record(layout?, child?, type?, *))

  • Default: {}

attribute-marker?

A string that is prepended to any key value in the output that represents an XDM attribute node in the input. The string may be empty. If, after applying the requested prefix (or no prefix) there is a conflict between the names of attributes and child elements, then the requested prefix (or lack thereof) is ignored and the default prefix "@" is used.
  • Type: xs:string

  • Default: "@"

name-format?

Indicates how the names of element and attribute nodes are handled.
  • Type: xs:string

  • Default: "default"

lexicalNames are output in the form produced by the fn:name function.
localNames are output in the form produced by the fn:local-name function.
eqnameNames in a namespace are output in the form "Q{uri}local". Names in no namespace are output using the local name alone.
defaultAn element name is output as a local name alone if either (a) it is a top-level element and is in no namespace, or (b) it is in the same namespace as its parent element. An attribute name is output as a local name alone if it is in no namespace. All other names are output in the format "Q{uri}local" if in a namespace, or "Q{}local" if in no namespace. "Top-level" here means that the element is one that appears explicitly in the sequence of elements passed in the $elements argument, as distinct from a descendant of such an element.

If $element is an empty sequence, the result is an empty sequence.

The principles for conversion from elements to maps are described in 14.5.1 Element Layouts, and the rules for selecting an element layout for each element are given in 14.5.5 Selecting an element layout.

In general, every descendant element within the tree rooted at the supplied $element maps to a key-value pair in which the key represents the element name, and the corresponding value represents the attributes and children of the element. This key-value pair will be added to the content representing its parent element, in a way that depends on the parent element's layout.

The representation of a node of any other kind depends on the layout chosen for its parent element.

Error Conditions

A dynamic error [err:FOJS0008] occurs if any element cannot be processed using the selected layout for that element, unless fallback processing is defined; or if error action is explicitly requested for an element.

Any error in the conversion plan is treated as a type error [err:XPTY0004]XP whether or not it is technically a contravention of the defined type for the value. This relieves users and implementers of the burden of distinguishing different kinds of error in the plan.

Examples
Expression:

element-to-map(())

Result:

()

Expression:

element-to-map(<foo>bar</foo>)

Result:

{ "foo": "bar" }

Expression:
element-to-map(
    <list>
      <item value='1'/>
      <item value='2'/>
    </list>, { 'attribute-marker': '' }
  )
Result:
{ "list": [ 
    { "value": "1" },
    { "value": "2" }
  ] }
Expression:
element-to-map(
    <name>
      <first>Jane</first>
      <last>Smith</last>
    </name>
  )
Result:
{ "name": { 
  "first": "Jane",
  "last": "Smith" 
} }
Expression:
element-to-map(
    <name xmlns="http://example.ns">
      <first>Jane</first>
      <middle>Elizabeth</middle>
      <middle>Mary</middle>
      <last>Smith</last>
    </name>, 
    { 'plan': {'name': { 'layout': 'record' }},
      'name-format' : 'local'
    }
  )
Result:
{ "name": { 
    "first": "Jane",
    "middle": ["Elizabeth", "Mary"],
    "last": "Smith" 
  } 
}
Expression:
element-to-map(
    <name xmlns="http://example.ns">
      <first>Jane</first>
      <middle>Elizabeth</middle>
      <middle>Mary</middle>
      <last>Smith</last>
    </name>, 
    { 'plan': {'name': { 'layout': 'record' },
               'middle': { 'layout': 'deep-skip' }
              },
      'name-format' : 'local'
    }
  )
Result:
{ "name": { 
    "first": "Jane",
    "last": "Smith" 
  } 
}

15 Processing arrays

Arrays were introduced as a new datatype in XDM 3.1. This section describes functions that operate on arrays.

An array is an additional kind of item. An array of size N is a mapping from the integers (1 to N) to a set of values, called the members of the array, each of which is an arbitrary sequence. Because an array is an item, and therefore a sequence, arrays can be nested.

An array acts as a function from integer positions to associated values, so the function call $array($index) can be used to retrieve the array member at a given position. The function corresponding to the array has the signature function($index as xs:integer) as item()*. The fact that an array is a function item allows it to be passed as an argument to higher-order functions that expect a function item as one of their arguments.

15.2 Functions that operate on arrays

The functions defined in this section use a conventional namespace prefix array, which is assumed to be bound to the namespace URI http://www.w3.org/2005/xpath-functions/array.

As with all other values, arrays are treated as immutable. For example, the array:reverse function returns an array that differs from the supplied array in the order of its members, but the supplied array is not changed by the operation. Two calls on array:reverse with the same argument will return arrays that are indistinguishable from each other; there is no way of asking whether these are “the same array”. Like sequences, arrays have no identity.

All functionality on arrays is defined in terms of two primitives:

  • The function array:members decomposes an array to a sequence of value records.

  • The function array:of-members composes an array from a sequence of value records.

A value record here is an item that encapsulates an arbitrary value; the representation chosen for a value record is record(value as item()*), that is, a map containing a single entry whose key is the string "value" and whose value is the encapsulated sequence.

Note that when the required type of an argument to a function such as array:build is an array type, then the coercion rules ensure that a JNode can be supplied in the function call: if the ·content· property of the JNode is an array, then the array is automatically extracted as if by the jnode-content function.

FunctionMeaning
array:appendReturns an array containing all the members of a supplied array, plus one additional member at the end.
array:buildReturns an array obtained by evaluating the supplied function once for each item in the input sequence.
array:emptyReturns true if the supplied array contains no members.
array:filterReturns an array containing those members of the $array for which $predicate returns true. A return value of () is treated as false.
array:flattenReplaces any array appearing in a supplied sequence with the members of the array, recursively.
array:fold-leftEvaluates the supplied function cumulatively on successive members of the supplied array.
array:fold-rightEvaluates the supplied function cumulatively on successive values of the supplied array.
array:footReturns the last member of an array.
array:for-eachReturns an array whose size is the same as array:size($array), in which each member is computed by applying $action to the corresponding member of $array.
array:for-each-pairReturns an array obtained by evaluating the supplied function once for each pair of members at the same position in the two supplied arrays.
array:getReturns the value at the specified position in the supplied array (counting from 1).
array:headReturns the first member of an array, that is $array(1).
array:index-ofReturns a sequence of positive integers giving the positions within the array $array of members that are equal to $target.
array:index-whereReturns the positions in an input array of members that match a supplied predicate.
array:insert-beforeReturns an array containing all the members of the supplied array, with one additional member at a specified position.
array:itemsReturns the sequence concatenation of the members of an array.
array:joinConcatenates the contents of several arrays into a single array, with an optional separator between adjacent members.
array:membersDelivers the contents of an array as a sequence of value records.
array:of-membersConstructs an array from the contents of a sequence of value records.
array:putReturns an array containing all the members of a supplied array, except for one member which is replaced with a new value.
array:removeReturns an array containing all the members of the supplied array, except for the members at specified positions.
array:reverseReturns an array containing all the members of a supplied array, but in reverse order.
array:sizeReturns the number of members in the supplied array.
array:sliceReturns an array containing selected members of a supplied input array based on their position.
array:sortSorts a supplied array, based on the value of a sort key supplied as a function.
array:sort-bySorts a supplied array, based on the value of a number of sort keys supplied as functions.
array:sort-withSorts a supplied array, according to the order induced by the supplied comparator functions.
array:splitDelivers the contents of an array as a sequence of single-member arrays.
array:subarrayReturns an array containing all members from a supplied array starting at a supplied position, up to a specified length.
array:tailReturns an array containing all members except the first from a supplied array.
array:trunkReturns an array containing all members except the last from a supplied array.

15.2.2 array:build

Changes in 4.0 (next | previous)

  1. New in 4.0  [Issue 97 PR 250]

Summary

Returns an array obtained by evaluating the supplied function once for each item in the input sequence.

Signature
array:build(
$inputas item()*,
$actionas (fn(item(), xs:integer) as item()*)?:= fn:identity#1
) as array(*)
Properties

This function is deterministic, context-independent, and focus-independent.

Rules

If the function is called with one argument, the effect is the same as calling the two-argument function with fn:identity#1 as the second argument.

Informally, array:build#2the function applies the supplied function to each item in the input sequence, and the resulting sequence becomes one member of the returned array.

Formal Equivalent

The effect of the function is equivalent to the result of the following XPath expression.

array:of-members(
  for-each($input, 
    fn($item, $pos) { { 'value': $action($item, $pos) } }
  )
)
Notes

The single-argument function array:build($input) is equivalent to the XPath expression array { $input }, but it is useful to have this available as a function.

The two-argument form facilitates the construction of arrays whose members are arbitrary sequences.

Examples
Expression:

array:build(1 to 5)

Result:

[ 1, 2, 3, 4, 5 ]

Expression:
array:build(1 to 5, fn { 2 * . })
Result:
[ 2, 4, 6, 8, 10 ]
Expression:
array:build(1 to 5, fn { 1 to . })
Result:
[ 1, (1, 2), (1, 2, 3), (1, 2, 3, 4), (1, 2, 3, 4, 5) ]
Expression:
array:build(("red", "green", "blue"), characters#1)
Result:
[ ("r", "e", "d"), ("g", "r", "e", "e", "n"), ("b", "l", "u", "e") ]
Expression:
array:build(1 to 5, fn { array { 1 to . } })
Result:
[ [ 1 ], [ 1, 2 ], [ 1, 2, 3 ], [ 1, 2, 3, 4 ], [ 1, 2, 3, 4, 5 ] ]
Expression:
array:build(
  (0x41 to 0x48) ! char(.),
  fn($char, $pos) {
    if ($pos mod 2 = 0) then lower-case($char) else $char
  }
)
Result:
[ "A", "b", "C", "d", "E", "f", "G", "h" ]

15.2.13 array:index-of

Changes in 4.0 (next | previous)

  1. New in 4.0  [Issues 260 1096 PRs 968 1295 6 February 2024]

Summary

Returns a sequence of positive integers giving the positions within the array $array of members that are equal to $target.

Signature
array:index-of(
$arrayas array(*),
$targetas item()*,
$collationas xs:string?:= fn:default-collation()
) as xs:integer*
Properties

The two-argument form of this function is deterministic, context-dependent, and focus-independent. It depends on collations, and implicit timezone.

The three-argument form of this function is deterministic, context-dependent, and focus-independent. It depends on collations, and static base URI, and implicit timezone.

Rules

Informally, all members of $array are compared with $target. An array member is compared to the target value using the rules of the fn:deep-equal function, with the specified (or defaulted) collation. The index position of the member is included in the result sequence if the comparison returns true.

The collation used by this function is determined according to the rules in 5.3.7 Choosing a collation. This collation is used when string comparison is required.

The first member in an array is at position 1, not position 0.

The result sequence is in ascending numeric order.

Formal Equivalent

The effect of the function is equivalent to the result of the following XPath expression.

array:index-where($array, deep-equal(?, $target, $collation))
Notes

If $array is the empty array, or if no member in $array matches $target, then the function returns the empty sequence.

Examples
Expression:

array:index-of([ 10, 20, 30, 30, 20, 10 ], 20)

Result:

2, 5

Expression:

array:index-of([ (), 1, (5, 6), (6, 7) ], (6, 7))

Result:

4

Expression:
array:index-of(
  [ "a", ("b", "C"), "d" ],
  ("B", "c"),
  "http://www.w3.org/2005/xpath-functions/collation/html-ascii-case-insensitive"
)
Result:
2
Expression:
array:index-of(
  [ '1', xs:untypedAtomic('1'), 1, current-date() ],
  '1'
)
Result:
1, 2

15.2.24 array:slice

Changes in 4.0 (next | previous)

  1. New in 4.0

Summary

Returns an array containing selected members of a supplied input array based on their position.

Signature
array:slice(
$arrayas array(*),
$startas xs:integer?:= ()0,
$endas xs:integer?:= ()0,
$stepas xs:integer?:= ()0
) as array(*)
Properties

This function is deterministic, context-independent, and focus-independent.

Rules

Informally, the array is converted to a sequence, the function fn:slice is applied to this sequence, and the resulting sequence is converted back to an array.

Formal Equivalent

The effect of the function is equivalent to the result of the following XPath expression.

$array 
=> array:members() 
=> slice($start, $end, $step) 
=> array:of-members()
Notes

Note that unlike other operations on arrays, there are no out-of-bounds errors for inappropriate values of $start, $end, or $step.

Examples
Variables
let $in := [ 'a', 'b', 'c', 'd', 'e' ]
ExpressionResult
array:slice($in, start := 2, end := 4)

[ "b", "c", "d" ]

array:slice($in, start := 2)

[ "b", "c", "d", "e" ]

array:slice($in, end := 2)

[ "a", "b" ]

array:slice($in, start := 3, end := 3)

[ "c" ]

array:slice($in, start := 4, end := 3)

[ "d", "c" ]

array:slice($in, start := 2, end := 5, step := 2)

[ "b", "d" ]

array:slice($in, start := 5, end := 2, step := -2)

[ "e", "c" ]

array:slice($in, start := 2, end := 5, step := -2)

[]

array:slice($in, start := 5, end := 2, step := 2)

[]

array:slice($in)

[ "a", "b", "c", "d", "e" ]

array:slice($in, start := -1)

[ "e" ]

array:slice($in, start := -3)

[ "c", "d", "e" ]

array:slice($in, end := -2)

[ "a", "b", "c", "d" ]

array:slice($in, start := 2, end := -2)

[ "b", "c", "d" ]

array:slice($in, start := -2, end := 2)

[ "d", "c", "b" ]

array:slice($in, start := -4, end := -2)

[ "b", "c", "d" ]

array:slice($in, start := -2, end := -4)

[ "d", "c", "b" ]

array:slice($in, start := -4, end := -2, step := 2)

[ "b", "d" ]

array:slice($in, start := -2, end := -4, step := -2)

[ "d", "b" ]

array:slice([ "a", "b", "c", "d" ], 0)

[ "a", "b", "c", "d" ]

15.2.25 array:sort

Summary

Sorts a supplied array, based on the value of a sort key supplied as a function.

Signature
array:sort(
$arrayas array(*),
$collationas xs:string?:= fn:default-collation(),
$keyas fn(item()*) as xs:anyAtomicType*:= fn:data#1
) as item()*
Properties

This function is deterministic, context-dependent, and focus-independent. It depends on collations.

Rules

This function is retained for compatibility from version 3.1 of this specification. Version 4.0 introduces a more powerful functions, array:sort-by.

The function call array:sort($array, $collation, $key) is defined to have the same effect as the call array:sort-by($array, { 'key': $key, 'collation': $collation, 'order': 'ascending'}). See array:sort-by.

The result of the function is a sequence that contains all the items from $input, typically in a different order, the order being defined by the supplied sort key definitions.

Formal Equivalent

The effect of the function is equivalent to the result of the following XPath expression.

array:sort-by($array, { 'key':$key, 'collation':$collation, 'order':'ascending' })
array:sort-by($array, { 'key': $key, 'collation': $collation, 'order': 'ascending' })
Error Conditions

If the set of computed sort keys contains values that are not comparable using the lt operator then the sort operation will fail with a type error ([err:XPTY0004]XP).

Examples
Expression:

array:sort([ 1, 4, 6, 5, 3 ])

Result:

[ 1, 3, 4, 5, 6 ]

Expression:

array:sort([ 1, -2, 5, 10, -10, 10, 8 ], (), abs#1)

Result:

[ 1, -2, 5, 8, 10, -10, 10 ]

Expression:

array:sort([ [ 2, "i" ], [ 1, "e" ], [ 2, "g" ], [ 1, "f" ] ])

Result:

[ [ 1, "e" ], [ 1, "f" ], [ 2, "g" ], [ 2, "i" ] ]

15.2.29 array:subarray

Changes in 4.0 (next | previous)

  1. Supplying an empty sequence as the value of an optional argument is equivalent to omitting the argument.

Summary

Returns an array containing all members from a supplied array starting at a supplied position, up to a specified length.

Signature
array:subarray(
$arrayas array(*),
$startas xs:integer,
$lengthas xs:integer?:= ()
) as array(*)
Properties

This function is deterministic, context-independent, and focus-independent.

Rules

Except in error cases, the two-argument version of the function returns the same result as the three-argument version when called with $length equal to the value of array:size($array) - $start + 1.

Setting the third argument to the empty sequence has the same effect as omitting the argument.

Formal Equivalent

The effect of the function is equivalent to the result of the following XPath expression, except in error cases.

$array
=> array:members()
=> subsequence($start, $length)
=> array:of-members()
Error Conditions

A dynamic error is raised [err:FOAY0001] if $start is less than one or greater than array:size($array) + 1.

For the three-argument version of the function:

  • A dynamic error is raised [err:FOAY0002] if $length is less than zero.

  • A dynamic error is raised [err:FOAY0001] if $start + $length is greater than array:size($array) + 1.

Notes

The value of $start can be equal to array:size($array) + 1 provided that $length is either equal to zero or omitted. In this case the result will be an empty array.

Examples
ExpressionResult
array:subarray([ "a", "b", "c", "d" ], 2)

[ "b", "c", "d" ]

array:subarray([ "a", "b", "c", "d" ], 5)

[]

array:subarray([ "a", "b", "c", "d" ], 2, 0)

[]

array:subarray([ "a", "b", "c", "d" ], 2, 1)

[ "b" ]

array:subarray([ "a", "b", "c", "d" ], 2, 2)

[ "b", "c" ]

array:subarray([ "a", "b", "c", "d" ], 5, 0)

[]

array:subarray([], 1, 0)

[]

16 Processing JNodes

Changes in 4.0 (next | previous)

  1. Introduced the concept of JNodes.   [Issue 2025 PR 2031 11 June 2025]

A JNodeDM is a wrapper around a map or array, or around a value that appears within the content of a map or array. JNodes are described at [XQuery and XPath Data Model (XDM) 4.0] section 8.4 JNodes. Wrapping a map or array in a JNode enables the use of path expressions such as $jnode/descendant::title, as described at [XML Path Language (XPath) 4.0] section 4.7 Path Expressions.

In addition to the functions defined in this section, functions that operate on JNodes include:

fn:distinct-ordered-nodes
fn:generate-id
fn:has-children
fn:innermost
fn:outermost
fn:path
fn:root
fn:siblings
fn:transitive-closure

16.1 Functions on JNodes

16.1.2 fn:jnode-content

Summary

Returns the ·content· property of a JNode.

Signature
fn:jnode-content(
$inputas jnode()?:= .
) as item()*
Properties

This function is deterministic, context-independent, and focus-independent.

Rules

If the argument is omitted, it defaults to the context value (.).

If $input is an empty sequence, the function returns an empty sequence.

Otherwise, the function returns the ·content· property of $input.

Error Conditions

The following errors may be raised when $node is omitted:

  • If the context value is absentDM, type error [err:XPDY0002]XP.

  • If the context value is not an instance of the sequence type jnode()?, type error [err:XPTY0004]XP.

Notes

In many cases it is unnecessary to make an explicit call on jnode-content, because the coercion rules will take care of this automatically. For example, in an expression such as $X / descendant::name [matches(., '^J')], the call on matches is supplied with a JNode as its first argument; atomization ensures that the actual value being passed to the first argument of matches is the atomized value of the ·content· property.

Other examples where the ·content· of a JNode is extracted automatically include:

  • Any context where the required type is an atomic value, for example arithmetic operations, value comparisons and general comparisons, and calls on functions that expect an atomic value.

  • Any context where the required type is a map or array, for example the first argument of functions such as map:size or array:size, a free-standing expression within a map constructor such as map{ $jnode }, the constructs for member and for key/value, the left-hand operand of the lookup operator ? (or the context value in the case of a unary lookup operator), and the operand of a map/array filter expression $jnode?[predicate].

Notable places where the ·content· is not automatically extracted include:

  • When computing the effective boolean value. As with XNodes, writing if ($array/child::*[1]) ... tests for the existence of a child, it does not test its value. To test its value, write if (jnode-content($array/child::*[1])) ..., or equivalently if (xs:boolean($array/child::*[1])) ....

  • When calling functions that accept arbitrary sequences, such as count or deep-equal.

It is possible (though probably unwise) to construct a JNode whose ·content· property itself contains another JNode. For example, the expression jtree([jtree([]), jtree([])]) creates a JNode whose ·content· is an array of JNodes, and applying the child axis to this JNode will return a sequence of two JNodes that themselves have further JNodes as their content. The jnode-content returns these contained JNodes, it does not recursively extract their content.

Examples
Expression:
let $array := [1, 3, 4.5, 7, "eight", 10]
return $array / child::type(xs:integer) =!> jnode-content()
Result:
1, 3, 7, 10
Expression:
let $map := {'Mo': 'Monday', 'Tu': 'Tuesday', 'We': 'Wednesday'}
return $map / child::get(("Mo", "We", "Fr", "Su")) =!> jnode-content()
Result:
"Monday", "Wednesday"
Expression:
let $array := [[4, 18], [30, 4, 22]]
return $array / descendant::*[. > 25][1] / ancestor-or-self::* =!> jnode-content()
Result:
[[4, 18], [30, 4, 22]], [30, 4, 22]

16.1.3 fn:jnode-selector

Changes in 4.0 (next | previous)

  1. New in 4.0  [Issue 2025 PR 2031 12 June 2025]

Summary

Returns the ·selector· property of a JNode.

Signature
fn:jnode-selector(
$inputas jnode()?:= .
) as xs:anyAtomicType?
Properties

This function is deterministic, context-independent, and focus-independent.

Rules

If the argument is omitted, it defaults to the context value (.).

If $input is an empty sequence, the function returns an empty sequence.

If $input is a root JNode (one in which the ·selector· property is absent), the function returns an empty sequence.

Otherwise, the function returns the ·selector· property of $input. In the case where the parent JNode wraps a map, this will be the key of the relevant entry within that map; in the case where the parent JNode wraps an array, it will be the 1-based index of the relevant member of the array.

Error Conditions

The following errors may be raised when $node is omitted:

  • If the context value is absentDM, type error [err:XPDY0002]XP.

  • If the context value is not an instance of the sequence type jnode()?, type error [err:XPTY0004]XP.

Examples
Expression:
let $array := [1, 3, 4.5, 7, "eight", 10]
return $array / child::type(xs:integer) =!> jnode-selector()
Result:
1, 2, 4, 6
Expression:
let $map := {'Mo': 'Monday', 'Tu': 'Tuesday', 'We': 'Wednesday'}
return $map / child::get(("Mo", "We", "Fr", "Su")) =!> jnode-selector()
Result:
"Mo", "We"
Expression:
let $array := [[4, 18], [30, 4, 22]]
return $array / descendant::*[. > 25] / ancestor-or-self::* =!> jnode-selector()
Result:
2, 1

16.1.4 fn:jnode-position

Changes in 4.0 (next | previous)

  1. New in 4.0  [Issue 2025 PR 2031 12 June 2025]

Summary

Returns the ·position· property of a JNode.

Signature
fn:jnode-position(
$inputas jnode()?:= .
) as xs:anyAtomicType?
Properties

This function is deterministic, context-independent, and focus-independent.

Rules

If the argument is omitted, it defaults to the context value (.).

If $input is an empty sequence, the function returns an empty sequence.

If $input is a root JNode (one in which the ·position· property is absent), the function returns an empty sequence.

Otherwise, the function returns the ·position· property of $input. The value of this property will be 1 (one) except in cases where the value of an entry in a map, or a member in an array, is a sequence that contains multiple items including maps and/or arrays; in such cases the position will be the 1-based position of the relevant map or array.

Error Conditions

The following errors may be raised when $node is omitted:

  • If the context value is absentDM, type error [err:XPDY0002]XP.

  • If the context value is not an instance of the sequence type jnode()?, type error [err:XPTY0004]XP.

Notes

This function is relevant only when there are maps whose entries are multi-item sequences that include maps and arrays, or arrays whose members include such multi-item sequences. Such structures are uncommon, and never arise from parsing of JSON source text. It is generally best to avoid such structures by using arrays rather than sequences within array and map content; apart from other considerations, this allows the data to be serialized in JSON format.

If an entry within a map, or a member of an array, contains a sequence of items that mixes arrays and maps with other content (for example the array [1, 2, ([1,2], [3,4], 5)), then a lookup using the child axis will only construct JNodes in respect of those items that are non-empty maps or arrays. This may leave gaps in the position numbering sequence, as illustrated in the examples below.

Examples
Expression:
let $input := {
   "a": [10, 20, 30], 
   "b": ([40, 50, 60], [], 0, [70, 80, (90, 100)])
}
return $input / child::b / * 
       ! { "position": jnode-position(),
           "index": jnode-selector(),
           "value": jnode-content()
         }
Result:
{ "position": 1, "index": 1, "value": 40 },
{ "position": 1, "index": 2, "value": 50 },
{ "position": 1, "index": 3, "value": 60 },
{ "position": 4, "index": 1, "value": 70 },
{ "position": 4, "index": 2, "value": 80 },
{ "position": 4, "index": 3, "value": (90, 100) }
Expression:
let $input := {
   "a": {"x": 10, "y": 20, "z": 30}, 
   "b": ( {"x": 40, "y": 50, "z": 60},
          {},
          {"x": 70, "y": 80, "z": (90, 100)})
}
return $input / child::b / * 
       ! { "position": jnode-position(),
           "key": jnode-selector(),
           "value": jnode-content()
         }
Result:
{ "position": 1, "key": "x", "value": 40 },
{ "position": 1, "key": "y", "value": 50 },
{ "position": 1, "key": "z", "value": 60 },
{ "position": 3, "key": "x", "value": 70 },
{ "position": 3, "key": "y", "value": 80 },
{ "position": 3, "key": "z", "value": (90, 100) }

17 External resources and data formats

These functions in this section access resources external to a query or stylesheet, and convert between external file formats and their XPath and XQuery data model representation.

17.1 Accessing external information

The functions in this section provide access to resources (such as files) in the external environment.

FunctionMeaning
fn:docRetrieves a document using a URI supplied as an xs:string, and returns the corresponding document node.
fn:doc-availableThe function returns true if and only if the function call fn:doc($source, $options) would return a document node.
fn:collectionReturns a sequence of items identified by a collection URI; or a default collection if no URI is supplied.
fn:uri-collectionReturns a sequence of xs:anyURI values representing the URIs in a URI collection.
fn:unparsed-textThe fn:unparsed-text function reads an external resource (for example, a file) and returns a string representation of the resource.
fn:unparsed-text-linesThe fn:unparsed-text-lines function reads an external resource (for example, a file) and returns its contents as a sequence of strings, one for each line of text in the string representation of the resource.
fn:unparsed-text-availableAllows an application to determine whether a call on fn:unparsed-text with particular arguments would succeed.
fn:unparsed-binaryThe fn:unparsed-binary function reads an external resource (for example, a file) and returns its contents in binary.
fn:environment-variableReturns the value of a system environment variable, if it exists.
fn:available-environment-variablesReturns a list of environment variable names that are suitable for passing to fn:environment-variable, as a (possibly empty) sequence of strings.

17.1.1 fn:doc

Changes in 4.0 (next | previous)

  1. The rule that multiple calls on fn:doc supplying the same absolute URI must return the same document node has been clarified; in particular the rule does not apply if the dynamic context for the two calls requires different processing of the documents (such as schema validation or whitespace stripping).  [Issue 898 PR 905 9 January 2024]

  2. An $options parameter is added. Note that the rules for the $options parameter control aspects of processing that were implementation-defined in earlier versions of this specification. An implementation may provide configuration options designed to retain backwards-compatible behavior when no explicit options are supplied.  [Issue 1021 PR 1910 6 April 2025]

Summary

Retrieves a document using a URI supplied as an xs:string, and returns the corresponding document node.

Signature
fn:doc(
$sourceas xs:string?,
$optionsas map(*)?:= {}
) as document-node()?
Properties

This function is deterministic, context-dependent, and focus-independent. It depends on available documents, and executable base URI.

Rules

If $source is the empty sequence, the result is an empty sequence.

If $source is a relative URI reference, it is resolved relative to the value of the executable base URIXP property from the dynamic context of the caller. The resulting absolute URI is promoted to an xs:string.

If the [TERMDEF dt-available-documents IN XP40] provides a mapping from this string to a document node, the function returns that document node.

Note:

The ability to access external resources depends on whether the calling code is trustedXP.

The URI may include a fragment identifier.

The $options argument, if present and non-empty, defines the detailed behavior of the function. The option parameter conventions apply. The options available are as follows:

record(
trusted?as xs:boolean,
dtd-validation?as xs:boolean,
stable?as xs:boolean,
strip-space?as xs:boolean?,
xinclude?as xs:boolean,
xsd-validation?as xs:string,
use-xsi-schema-location?as xs:boolean
)
KeyValueMeaning

trusted?

Indicates whether processing the document may cause other external resources to be fetched (including, for example, external entities, an external DTD, or documents referenced using xsi:schemaLocation or XInclude elements).
  • Type: xs:boolean

  • Default: false()

trueThe document may include references to other external resources.
falseThe document must not include references to other external resources unless access to these resources has been explicitly enabled.

dtd-validation?

Determines whether DTD validation takes place.
  • Type: xs:boolean

  • Default: false

trueThe input is parsed using a validating XML parser. The input must contain a DOCTYPE declaration to identify the DTD to be used for validation. The DTD may be internal or external.
falseDTD validation does not take place. However, if a DOCTYPE declaration is present, then it is read, for example to perform entity expansion.

stable?

Determines whether two calls on the doc function, with the same URI, the same options, and the same context, are guaranteed to return the same document node. The default value is true, but this may be overridden by implementation-defined configuration options.
  • Type: xs:boolean

  • Default: true

trueGiven the same explicit and implicit arguments, multiple calls return the same document node: that is, the function is deterministic.
falseMultiple calls with the same explicit and implicit arguments may return the same document node or different document nodes at the discretion of the implementation.

strip-space?

Determines whether whitespace-only text nodes are removed from the resulting document. The default is defined by the host language or by the implementation. (Note: in XSLT, the xsl:strip-space and xsl:preserve-space declarations provide detailed control based on the parent element name.)
  • Type: xs:boolean?

  • Default: ()

trueAll whitespace-only text nodes are stripped, unless either (a) they are within the scope of the attribute xml:space="preserve", or (b) XSD validation identifies that the parent element has a simple type or a complex type with simple content.
falseAll whitespace-only text nodes are preserved, unless either (a) DTD validation marks them as ignorable, or (b) XSD validation recognizes the containing element as having element-only or empty content.

xinclude?

Determines whether any xi:include elements in the input are to be processed using an XInclude processor.
  • Type: xs:boolean

  • Default: false

trueAny xi:include elements are expanded. If there are xi:include elements and no XInclude processor is available then a dynamic error is raised.
falseAny xi:include elements are handled as ordinary elements without expansion.

xsd-validation?

Determines whether XSD validation takes place, using the schema definitions present in the static context. The effect of requesting validation is the same as invoking the doc function without validation, and then applying an XQuery validate expression to the result, with corresponding options.
  • Type: xs:string

  • Default: "skip"

strictStrict XSD validation takes place
laxLax XSD validation takes place
skipNo XSD validation takes place
type Q{uri}localXSD validation takes place against the schema-defined type, present in the static context, that has the given URI and local name.

use-xsi-schema-location?

When XSD validation takes place, determines whether schema components referenced using xsi:schemaLocation or xsi:noNamespaceSchemaLocation attributes within the source document are to be used. The option is ignored if XSD validation does not take place.
  • Type: xs:boolean

  • Default: false

trueXSD validation uses the schema components referenced using xsi:schemaLocation or xsi:noNamespaceSchemaLocation attributes in addition to the schema components present in the static context; these components must be compatible as described in [XQuery and XPath Data Model (XDM) 4.0] section 4.1.2 Schema Consistency.
falseAny xsi:schemaLocation and xsi:noNamespaceSchemaLocation attributes in the document are ignored.

By default, this function is deterministic. Two calls on this function return the same document node if the same URI Reference (after resolution to an absolute URI Reference) is supplied to both calls. Thus, the following expression (if it does not raise an error) will always return true:

doc("foo.xml") is doc("foo.xml")

Note:

This equivalence applies only because the two calls on the fn:doc function have the same options and the same static and dynamic context, to the extent this is relevant. If two calls on fn:doc have different dynamic contexts, then the mapping from URIs to document nodes in the two contexts may differ, which means that different document nodes may be returned for the same URI. This can happen, for example, if the two calls appear in different XSLT packages with different validation options or whitespace-stripping options; one call might produce a schema-validated document, the other an untyped document.

The requirement to deliver a deterministic result has performance implications, and for this reason implementations may provide a user option to evaluate the function without a guarantee of determinism. The manner in which any such option is provided is implementation-defined. If the user has not selected such an option, a call of the function must either return a deterministic result or must raise a dynamic error [err:FODC0003].

Note:

If the $source URI is obtained from a source document, it is generally appropriate to resolve it relative to the base URI property of the relevant node in the source document. This can be achieved by calling the fn:resolve-uri function, and passing the resulting absolute URI as an argument to the fn:doc function.

If two calls to this function supply different absolute URI References as arguments, the same document node may be returned if the implementation can determine that the two arguments refer to the same resource.

By defining the semantics of this function in terms of a string-to-document-node mapping in the dynamic context, the specification is acknowledging that the results of this function are outside the purview of the language specification itself, and depend entirely on the run-time environment in which the expression is evaluated. This run-time environment includes not only an unpredictable collection of resources (“the web”), but configurable machinery for locating resources and turning their contents into document nodes within the XPath data model. Both the set of resources that are reachable, and the mechanisms by which those resources are parsed and validated, are implementation-dependent.

One possible processing model for this function is as follows. The resource identified by the URI Reference is retrieved. If the resource cannot be retrieved, a dynamic error is raised [err:FODC0002]. The data resulting from the retrieval action is then parsed as an XML document and a tree is constructed in accordance with the [XQuery and XPath Data Model (XDM) 3.0]. If the top-level media type is known and is "text", the content is parsed in the same way as if the media type were text/xml; otherwise, it is parsed in the same way as if the media type were application/xml. If the contents cannot be parsed successfully, a dynamic error is raised [err:FODC0002]. Otherwise, the result of the function is the document node at the root of the resulting tree. This tree is then optionally validated against a schema.

Various aspects of this processing are implementation-defined. Implementations may provide external configuration options that allow any aspect of the processing to be controlled by the user. In particular:

  • The set of URI schemes that the implementation recognizes is implementation-defined. Implementations may allow the mapping of URIs to resources to be configured by the user, using mechanisms such as catalogs or user-written URI handlers.

  • The handling of non-XML media types is implementation-defined. Implementations may allow instances of the data model to be constructed from non-XML resources, under user control.

  • It is implementation-defined whether DTD validation and/or schema validation is applied to the source document.

  • Implementations may provide user-defined error handling options that allow processing to continue following an error in retrieving a resource, or in parsing and validating its content. When errors have been handled in this way, the function may return either an empty sequence, or a fallback document provided by the error handler.

  • Implementations may provide user options that relax the requirement for the function to return deterministic results.

  • The effect of a fragment identifier in the supplied URI is implementation-defined. One possible interpretation is to treat the fragment identifier as an ID attribute value, and to return a document node having the element with the selected ID value as its only child.

Error Conditions

A dynamic error may be raised [err:FODC0005] if $source is not a valid URI reference.

A dynamic error is raised [err:FODC0002] if a relative URI reference is supplied, and the base-URI property in the static context is absent.

A dynamic error is raised [err:FODC0002] if the available documents provides no mapping for the absolutized URI.

A dynamic error is raised [err:FODC0002] if the resource cannot be retrieved or cannot be parsed successfully as XML using the selected options.

A dynamic error is raised [err:FODC0003] if the implementation is not able to guarantee that the result of the function will be deterministic, and the user has not indicated that an unstable result is acceptable.

17.1.2 fn:doc-available

Changes in 4.0 (next | previous)

  1. An $options parameter is added. Note that the rules for the $options parameter control aspects of processing that were implementation-defined in earlier versions of this specification. An implementation may provide configuration options designed to retain backwards-compatible behavior when no explicit options are supplied.  [Issue 1021 PR 1910 6 April 2025]

Summary

The function returns true if and only if the function call fn:doc($source, $options) would return a document node.

Signature
fn:doc-available(
$sourceas xs:string?,
$optionsas map(*)?:= {}
) as xs:boolean
Properties

This function is deterministic, context-dependent, and focus-independent. It depends on available documents, and executable base URI.

Rules

If $source is an empty sequence, this function returns false.

If a call on fn:doc($source, $options) would return a document node, this function returns true.

In all other cases this function returns false. This includes the case where an invalid URI is supplied, and also the case where a valid relative URI reference is supplied, and cannot be resolved, for example because the static base URI is absent.

The recognized values for $options are the same as for the fn:doc function. The option parameter conventions apply. Note that if the stable option is set to true, then a result of true from this function guarantees that a call on fn:doc with the same explicit and implicit arguments will succeed, whereas a result of false from this function guarantees that the corresponding call on fn:doc will fail. Conversely, if the stable option is set to false, then the result of this function provides no guarantees regarding the outcome of a call on fn:doc with the same explicit and implicit arguments.

Error Conditions

Like any other function, doc-available fails with an error if invalid arguments are supplied: for example if the first argument is not a string, or if unrecognized options are included in $options. However, it returns false rather than raising an error if the first argument is invalid as a URI.

The function also returns false (rather than raising an error) if the document is unavailable because of processor limitations, for example if schema validation is requested and the processor is not schema-aware.

17.1.3 fn:collection

Summary

Returns a sequence of items identified by a collection URI; or a default collection if no URI is supplied.

Signature
fn:collection(
$sourceas xs:string?:= ()
) as item()*
Properties

This function is deterministic, context-dependent, and focus-independent. It depends on available collections, and executable base URI.

Rules

This function takes an xs:string as argument and returns a sequence of items obtained by interpreting $source as an xs:anyURI and resolving it according to the mapping specified in available collections described in [XML Path Language (XPath) 4.0] section B.2 Dynamic Context Components.

If available collections provides a mapping from this string to a sequence of items, the function returns that sequence. If available collections maps the string to an empty sequence, then the function returns an empty sequence.

If $source is not specifiedthe empty sequence, the function returns the sequence of items in the default collection in the dynamic context. See [XML Path Language (XPath) 4.0] section B.2 Dynamic Context Components.

If $source is a relative URI reference, it is resolved relative to the value of the executable base URIXP property from the dynamic context of the caller. The resulting absolute URI is promoted to an xs:string.

If $source is the empty sequence, the function behaves as if it had been called without an argument. See above.

By default, this function is deterministic. This means that repeated calls on the function with the same argument will return the same result. However, for performance reasons, implementations may provide a user option to evaluate the function without a guarantee of determinism. The manner in which any such option is provided is implementation-defined. If the user has not selected such an option, a call to this function must either return a deterministic result or must raise a dynamic error [err:FODC0003].

There is no requirement that any nodes in the result should be in document order, nor is there a requirement that the result should contain no duplicates.

Note:

The ability to access external resources depends on whether the calling code is trustedXP.

Error Conditions

A dynamic error is raised [err:FODC0002] if no URI is supplied and the value of the default collection is absentDM.

A dynamic error is raised [err:FODC0002] if a relative URI reference is supplied, and the base-URI property in the static context is absent.

A dynamic error is raised [err:FODC0002] if available node collections provides no mapping for the absolutized URI.

A dynamic error may be raised [err:FODC0004] if $source is not a valid xs:anyURI.

Notes

In earlier versions of this specification, the primary use for the fn:collection function was to retrieve a collection of XML documents, perhaps held as lexical XML in operating system filestore, or perhaps held in an XML database. In this release the concept has been generalised to allow other resources to be retrieved: for example JSON documents might be returned as arrays or maps, non-XML text files might be returned as strings, and binary files might be returned as instances of xs:base64Binary.

The abstract concept of a collection might be realized in different ways by different implementations, and the ways in which URIs map to collections can be equally variable. Specifying resources using URIs is useful because URIs are dynamic, can be parameterized, and do not rely on an external environment.

17.1.4 fn:uri-collection

Summary

Returns a sequence of xs:anyURI values representing the URIs in a URI collection.

Signature
fn:uri-collection(
$sourceas xs:string?:= ()
) as xs:anyURI*
Properties

This function is deterministic, context-dependent, and focus-independent. It depends on available URI collections, and executable base URI.

Rules

The zeroIf -argument$source form of theis the empty sequence, the function returns the URIs in the default URI collection described in [XML Path Language (XPath) 4.0] section B.2 Dynamic Context Components.

If $source is a relative URI reference, it is resolved relative to the value of the executable base URIXP property from the dynamic context of the caller. The resulting absolute URI is promoted to an xs:string.

If $source is the empty sequence, the function behaves as if it had been called without an argument. See above.

The single-argument form of the function returns the sequence of URIs corresponding to the supplied URI in the available URI collections described in [XML Path Language (XPath) 4.0] section B.2 Dynamic Context Components.

By default, this function is deterministic. This means that repeated calls on the function with the same argument will return the same result. However, for performance reasons, implementations may provide a user option to evaluate the function without a guarantee of determinism. The manner in which any such option is provided is implementation-defined. If the user has not selected such an option, a call to this function must either return a deterministic result or must raise a dynamic error [err:FODC0003].

There is no requirement that the URIs returned by this function should all be distinct, and no assumptions can be made about the order of URIs in the sequence, unless the implementation defines otherwise.

Note:

The ability to access external resources depends on whether the calling code is trustedXP.

Error Conditions

A dynamic error is raised [err:FODC0002] if no URI is supplied (that is, if the function is called with no arguments, or with a single argument that evaluates to an empty sequence), and the value of the default resource collection is absentDM.

A dynamic error is raised [err:FODC0002] if a relative URI reference is supplied, and the base-URI property in the static context is absent.

A dynamic error is raised [err:FODC0002] if available resource collections provides no mapping for the absolutized URI.

A dynamic error may be raised [err:FODC0004] if $source is not a valid xs:anyURI.

Notes

In some implementations, there might be a close relationship between collections (as retrieved by the fn:collection function), and URI collections (as retrieved by this function). For example, a collection might return XML documents, and the corresponding URI collection might return the URIs of those documents. However, this specification does not impose such a close relationship. For example, there may be collection URIs accepted by one of the two functions and not by the other; a collection might contain items that do not have any URI; or a URI collection might contain URIs that cannot be dereferenced to return any resource.

In the case where fn:uri-collection returns the URIs of resources that could also be retrieved directly using fn:collection, there are several reasons why it might be appropriate to use this function in preference to the fn:collection function. For example:

  • It allows different URIs for different kinds of resource to be dereferenced in different ways: for example, the returned URIs might be referenced using the fn:unparsed-text function rather than the fn:doc function.

  • In XSLT 3.0 it allows the documents in a collection to be processed in streaming mode using the xsl:stream instruction.

  • It allows recovery from failures to read, parse, or validate individual documents, by calling the fn:doc (or other dereferencing) function within the scope of try/catch.

  • It allows selection of which documents to read based on their URI, for example they can be filtered to select those whose URIs end in .xml, or those that use the https scheme.

  • An application might choose to limit the number of URIs processed in a single run, for example it might process only the first 50 URIs in the collection; or it might present the URIs to the user and allow the user to select which of them need to be further processed.

  • It allows the URIs to be modified before they are dereferenced, for example by adding or removing query parameters, or by redirecting the request to a local cache or to a mirror site.

For some of these use cases, this assumes that the cost of calling fn:collection might be significant (for example, it might involving retrieving all the documents in the collection over the network and parsing them). This will not necessarily be true of all implementations.

17.1.5 fn:unparsed-text

Changes in 4.0 (next | previous)

  1. The $options parameter has been added.  [Issue 1116 PR 1117 21 May 2024]

  2. It is no longer automatically an error if the resource (after decoding) contains a codepoint that is not valid in XML. Instead, the codepoint must be a permitted character. The set of permitted characters is implementation-defined, but it is recommended that all Unicode characters should be accepted.  [Issue 414 PR 546 25 July 2023]

  3. The specification now describes in more detail how to determine the effective encoding value.  [Issue 2221 PR 2248]

Summary

The fn:unparsed-text function reads an external resource (for example, a file) and returns a string representation of the resource.

Signature
fn:unparsed-text(
$sourceas xs:string?,
$optionsas (xs:string | map(*))?:= (){}
) as xs:string?
Properties

This function is deterministic, context-dependent, and focus-independent. It depends on executable base URI.

Rules

The $source argument must be a string in the form of a URI reference, which must contain no fragment identifier, and must identify a resource for which a string representation is available.

If $source is a relative URI reference, it is resolved relative to the value of the executable base URIXP property from the dynamic context of the caller. The resulting absolute URI is promoted to an xs:string.

The $options argument, for backwards compatibility reasons, may be supplied either as a map, or as a string. Supplying a value $S that is not a map is equivalent to supplying the map { "encoding": $S }. After that substitution, the option parameter conventions apply.

The entries that may appear in the $options map are as follows:

record(
encoding?as xs:string?,
normalize-newlines?as xs:boolean
)
KeyValueMeaning

encoding?

Defines the encoding of the resource, as described below.
  • Type: xs:string?

  • Default: ()

normalize-newlines?

Determines whether CR and CRLF character sequences are treated as equivalent to NL characters.
  • Type: xs:boolean

  • Default: false

falseNo normalization of line endings takes place.
trueThe character U+000D (CARRIAGE RETURN) and the character pair (U+000D (CARRIAGE RETURN) , U+000A (NEWLINE) ) are converted to the single character U+000A (NEWLINE) .

The mapping of URIs to the string representation of a resource is the mapping defined in the [TERMDEF dt-available-text-resources IN XP40]available text resources component of the dynamic context.

If the $source argument is an empty sequence, the function returns an empty sequence.

The encoding option, if present and non-empty, is the name of an encoding. The values for this option follow the same rules as for the encoding attribute in an XML declaration. The values which an implementation is required to recognize are utf-8, utf-16, utf-16le, and utf-16be.

The encoding candidate E is chosen as follows:

  1. external encoding information if available; otherwise

  2. the encoding recognized as specified in [Extensible Markup Language (XML) 1.0 (Fifth Edition)] if the media type of the resource is text/xml or application/xml (see [RFC 2376]), or if it matches the conventions text/*+xml or application/*+xml (see [RFC 7303] and/or its successors); otherwise

  3. the value of the encoding option if present.

The effective encoding is determined as follows:

  1. utf-8 if E is utf-8 or absent, and if the initial octets xEF, xBB and xBF can be consumed; otherwise

  2. utf-16le if E is utf-16, utf-16le or absent, and if the initial octets xFF and xFE can be consumed; otherwise

  3. utf-16be if E is utf-16, utf-16be or absent, and if the initial octets xFE and xFF can be consumed; otherwise

  4. utf-16be if E is utf-16; otherwise

  5. the value of E if present; otherwise

  6. utf-8, or a value that results from implementation-defined heuristics.

If a UTF encoding is determined, and if the input starts with a byte order mark, it is ignored.

The result of the function is a string containing the string representation of the resource retrieved using the URI, decoded according to the effective encoding.

Note:

The ability to access external resources depends on whether the calling code is trustedXP.

Error Conditions

A dynamic error is raised [err:FOUT1170] if the $source argument contains a fragment identifier, or if it cannot be resolved to an absolute URI (for example, because the base-URI property in the static context is absent), or if it cannot be used to retrieve the string representation of a resource.

A dynamic error is raised [err:FOUT1190] if the value of the encoding option is not a valid encoding name, if the processor does not support the specified encoding, if the string representation of the retrieved resource contains octets that cannot be decoded into Unicode characters using the specified encoding, or if any resulting character is not a permitted character.

A dynamic error is raised [err:FOUT1200] if the encoding option is absent and the processor cannot infer the encoding using external information and the actual encoding is not UTF-8.

Notes

If it is appropriate to use a base URI other than the executable base URIXP (for example, when resolving a relative URI reference read from a source document) then it is advisable to resolve the relative URI reference using the fn:resolve-uri function before passing it to the fn:unparsed-text function.

There is no essential relationship between the sets of URIs accepted by the two functions fn:unparsed-text and fn:doc (a URI accepted by one may or may not be accepted by the other), and if a URI is accepted by both there is no essential relationship between the results (different resource representations are permitted by the architecture of the web).

There are no constraints on the MIME type of the resource.

The fact that the resolution of URIs is defined by a mapping in the dynamic context means that in effect, various aspects of the behavior of this function are implementation-defined. Implementations may provide external configuration options that allow any aspect of the processing to be controlled by the user. In particular:

  • The set of URI schemes that the implementation recognizes is implementation-defined. Implementations may allow the mapping of URIs to resources to be configured by the user, using mechanisms such as catalogs or user-written URI handlers.

  • The handling of media types is implementation-defined.

  • Implementations may provide user options that relax the requirement for the function to return deterministic results.

  • Implementations may provide user-defined error handling options that allow processing to continue following an error in retrieving a resource, or in reading its content. When errors have been handled in this way, the function may return a fallback document provided by the error handler.

The rules for determining the encoding are chosen for consistency with [XML Inclusions (XInclude) Version 1.0 (Second Edition)]. Files with an XML media type are treated specially because there are use cases for this function where the retrieved text is to be included as unparsed XML within a CDATA section of a containing document, and because processors are likely to be able to reuse the code that performs encoding detection for XML external entities.

If the text file contains characters such as < and &, these will typically be output as &lt; and &amp; if the string is serialized as XML or HTML. If these characters actually represent markup (for example, if the text file contains HTML), then an XSLT stylesheet can attempt to write them as markup to the output file using the disable-output-escaping attribute of the xsl:value-of instruction. Note, however, that XSLT implementations are not required to support this feature.

Examples

This XSLT example attempts to read a file containing “boilerplate” HTML and copy it directly to the serialized output file:

<xsl:output method="html"/>

<xsl:template match="/">
  <xsl:value-of select="unparsed-text('header.html', 'iso-8859-1')"
                disable-output-escaping="yes"/>
  <xsl:apply-templates/>
  <xsl:value-of select="unparsed-text('footer.html', 'iso-8859-1')"
                disable-output-escaping="yes"/>
</xsl:template>

17.1.6 fn:unparsed-text-lines

Changes in 4.0 (next | previous)

  1. The $options parameter has been added.  [Issues 1116 1278 PRs 1117 1279 21 May 2024]

Summary

The fn:unparsed-text-lines function reads an external resource (for example, a file) and returns its contents as a sequence of strings, one for each line of text in the string representation of the resource.

Signature
fn:unparsed-text-lines(
$sourceas xs:string?,
$optionsas (xs:string | map(*))?:= (){}
) as xs:string*
Properties

This function is deterministic, context-dependent, and focus-independent. It depends on executable base URI.

Rules

The unparsed-text-lines function reads an external resource (for example, a file) and returns its string representation as a sequence of strings, separated at newline boundaries.

The $options argument, for backwards compatibility reasons, may be supplied either as a map, or as a string. Supplying a value $S that is not a map is equivalent to supplying the map { "encoding": $S }. After that substitution, the option parameter conventions apply.

The entries that may appear in the $options map are as follows:

record(
encoding?as xs:string?
)
KeyMeaning

encoding?

Defines the encoding of the resource, following the rules of fn:unparsed-text.
  • Type: xs:string?

  • Default: ()

The result of the function is the same as the result of the expression:

let $text := unparsed-text($source, map:put($options, 'normalize-newlines', true()))
let $lines := tokenize($text, '\n')
return $lines[not(position() = last() and . = '')]

The result is thus a sequence of strings containing the text of the resource retrieved using the URI, each string representing one line of text. Lines may be delimited by any of the character sequences U+000A (NEWLINE) , U+000D (CARRIAGE RETURN) , or U+000D (CARRIAGE RETURN) followed by U+000A (NEWLINE) . Line ending characters are not included in the returned strings. If there are two adjacent newline sequences, a zero-length string will be returned to represent the empty line; but if the external resource ends with a newline sequence, the result will be as if this final line ending were not present.

Note:

The ability to access external resources depends on whether the calling code is trustedXP.

Error Conditions

Error conditions are the same as for the fn:unparsed-text function.

Notes

See the notes for fn:unparsed-text.

17.1.7 fn:unparsed-text-available

Changes in 4.0 (next | previous)

  1. The $options parameter has been added.  [Issue 1116 PR 1117 21 May 2024]

Summary

Allows an application to determine whether a call on fn:unparsed-text with particular arguments would succeed.

Signature
fn:unparsed-text-available(
$sourceas xs:string?,
$optionsas (xs:string | map(*))?:= (){}
) as xs:boolean
Properties

This function is deterministic, context-dependent, and focus-independent. It depends on executable base URI.

Rules

The fn:unparsed-text-available function determines whether a call on the fn:unparsed-text function with identical arguments would return a string.

If the first argument is an empty sequence, the function returns false.

In other cases, the function returns true if a call on fn:unparsed-text or fn:unparsed-text-lines with the same arguments would succeed, and false if a call on fn:unparsed-text or fn:unparsed-text-lines with the same arguments would fail with a non-recoverable dynamic error.

The functions fn:unparsed-text and fn:unparsed-text-available have the same requirement for determinism as the functions fn:doc and fn:doc-available. This means that unless the user has explicitly stated a requirement for a reduced level of determinism, either of these functions if called twice with the same arguments during the course of a transformation must return the same results each time; moreover, the results of a call on fn:unparsed-text-availablemust be consistent with the results of a subsequent call on unparsed-text with the same arguments.

Note:

The ability to access external resources depends on whether the calling code is trustedXP.

Notes

This function was introduced before XQuery and XSLT allowed errors to be caught; with current versions of these host languages, catching an error from fn:unparsed-text may provide a better alternative.

The specification requires that the fn:unparsed-text-available function should actually attempt to read the resource identified by the URI, and check that it is correctly encoded and contains no characters that are invalid in XML. Implementations may avoid the cost of repeating these checks for example by caching the validated contents of the resource, to anticipate a subsequent call on the fn:unparsed-text or fn:unparsed-text-lines function. Alternatively, implementations may be able to rewrite an expression such as if (unparsed-text-available(A)) then unparsed-text(A) else ... to generate a single call internally.

Since the function fn:unparsed-text-lines succeeds or fails under exactly the same circumstances as fn:unparsed-text, the fn:unparsed-text-available function may equally be used to test whether a call on fn:unparsed-text-lines would succeed.

17.2 Functions on XML Data

These functions convert between the lexical representation of XML and the tree representation.

(The fn:serialize function also handles HTML and JSON output, but is included in this section for editorial convenience.)

FunctionMeaning
fn:parse-xmlThis function takes as input an XML document, and returns the document node at the root of an XDM tree representing the parsed document.
fn:parse-xml-fragmentThis function takes as input an XML external entity represented as a string, and returns the document node at the root of an XDM tree representing the parsed document fragment.
fn:serializeThis function serializes the supplied input sequence $input as described in [XSLT and XQuery Serialization 3.1], returning the serialized representation of the sequence as a string.
fn:xsd-validatorGiven an XSD schema, delivers a function item that can be invoked to validate a document or element node against this schema.

17.2.1 fn:parse-xml

Changes in 4.0 (next | previous)

  1. The $options parameter has been added.  [Issue 305 PR 1257 11 June 2024]

  2. Additional error conditions have been defined.  [Issue 1287 PR 1288 25 June 2024]

  3. Additional options to control DTD and XInclude processing have been added.  [Issues 1857 1860 PR 1879 18 March 2025]

  4. Support for binary input has been added.  [Issue 748 PR 2013 20 May 2025]

Summary

This function takes as input an XML document, and returns the document node at the root of an XDM tree representing the parsed document.

Signature
fn:parse-xml(
$valueas (xs:string | xs:hexBinary | xs:base64Binary)?,
$optionsas map(*)?:= {}
) as document-node(*)?
Properties

This function is nondeterministic, context-dependent, and focus-independent. It depends on executable base URI.

Rules

If $value is the empty sequence, the function returns the empty sequence.

In other cases, $value is expected to contain an XML document supplied either as a string or a binary value. If it is supplied as a binary value, an optional byte order mark or XML declaration may contain the input encoding, and the input will be processed like a resource retrieved by the fn:doc function. Otherwise, if the input is a string, any byte order mark as well as the encoding specified in an optional XML declaration should be ignored.

The $options argument, if present and non-empty, defines the detailed behavior of the function. The option parameter conventions apply. The options available are as follows:

record(
base-uri?as xs:anyURI,
dtd-validation?as xs:boolean,
strip-space?as xs:boolean,
trusted?as xs:boolean,
xinclude?as xs:boolean,
xsd-validation?as xs:string,
use-xsi-schema-location?as xs:boolean
)
KeyValueMeaning

base-uri?

Determines the base URI. This is used both as the base URI used by the XML parser to resolve relative entity references within the document, and as the base URI of the document node that is returned. It defaults to the static base URI of the function call.
  • Type: xs:anyURI

  • Default: static-base-uri()

dtd-validation?

Determines whether DTD validation takes place.
  • Type: xs:boolean

  • Default: false

trueThe input is parsed using a validating XML parser. The input must contain a DOCTYPE declaration to identify the DTD to be used for validation. The DTD may be internal or external.
falseDTD validation does not take place. However, if a DOCTYPE declaration is present, then it is read, for example to perform entity expansion.

strip-space?

Determines whether whitespace-only text nodes are removed from the resulting document. (Note: in XSLT, the xsl:strip-space and xsl:preserve-space declarations are ignored.)
  • Type: xs:boolean

  • Default: false

trueAll whitespace-only text nodes are stripped, unless either (a) they are within the scope of the attribute xml:space="preserve", or (b) XSD validation identifies that the parent element has a simple type or a complex type with simple content.
falseAll whitespace-only text nodes are preserved, unless either (a) DTD validation marks them as ignorable, or (b) XSD validation recognizes the containing element as having element-only or empty content.

trusted?

Indicates whether processing the supplied document may cause external resources to be fetched (including, for example, external entities, an external DTD, or documents referenced using xsi:schemaLocation or XInclude elements).
  • Type: xs:boolean

  • Default: false()

trueThe document may include references to external resources.
falseThe document must not include references to external resources unless access to these resources has been explicitly enabled.

xinclude?

Determines whether any xi:include elements in the input are to be processed using an XInclude processor.
  • Type: xs:boolean

  • Default: false

trueAny xi:include elements are expanded. If there are xi:include elements and no XInclude processor is available then a dynamic error is raised.
falseAny xi:include elements are handled as ordinary elements without expansion.

xsd-validation?

Determines whether XSD validation takes place, using the schema definitions present in the static context. The effect of requesting validation is the same as invoking the parse-xml function without validation, and then applying an XQuery validate expression to the result, with corresponding options.
  • Type: xs:string

  • Default: "skip"

strictStrict XSD validation takes place
laxLax XSD validation takes place
skipNo XSD validation takes place
type Q{uri}localXSD validation takes place against the schema-defined type, present in the static context, that has the given URI and local name.

use-xsi-schema-location?

When XSD validation takes place, determines whether schema components referenced using xsi:schemaLocation or xsi:noNamespaceSchemaLocation attributes within the source document are to be used. The option is ignored if XSD validation does not take place.
  • Type: xs:boolean

  • Default: false

trueXSD validation uses the schema components referenced using xsi:schemaLocation or xsi:noNamespaceSchemaLocation attributes in addition to the schema components present in the static context; these components must be compatible as described in [XQuery and XPath Data Model (XDM) 4.0] section 4.1.2 Schema Consistency.
falseAny xsi:schemaLocation and xsi:noNamespaceSchemaLocation attributes in the document are ignored.

Except to the extent defined by these options, the precise process used to construct the XDM instance is implementation-defined. In particular, it is implementation-defined whether an XML 1.0 or XML 1.1 parser is used.

The document URI of the returned node is absentDM.

The function is notdeterministic: that is, if the function is called twice with the same arguments, it is implementation-dependent whether the same node is returned on both occasions.

Options set in $options may be supplemented or modified based on configuration options defined externally using implementation-defined mechanisms.

Error Conditions

A dynamic error is raised [err:FODC0006] if the content of $value is not a well-formed and namespace-well-formed XML document.

A dynamic error is raised [err:FODC0007] if DTD validation is carried out and the content of $value is not valid against the relevant DTD.

A dynamic error is raised [err:FODC0008] if the value of the xsd-validation option is not one of the permitted values (for example, if the string that follows "type" is not a valid EQName, or if it does not identify a type that is present in the static context).

A dynamic error is raised [err:FODC0009] if the value of the xsd-validation option is set to anything other than skip when the processor is not schema-aware. (XSLT 4.0 and XQuery 4.0 define schema-awareness as an optional feature; other host languages may set their own rules.)

A dynamic error is raised [err:FODC0013] if processor does not have access to an XML parser supporting the requested options, for example the ability to perform DTD validation or XInclude processing or to prevent access to external entities.

A dynamic error is raised [err:FODC0014] if XSD validation is carried out and the content of $value is not valid against the relevant XSD schema.

Notes

Since the XML document is presented to the parser as a string, rather than as a sequence of octets, the encoding specified within the XML declaration has no meaning. If the XML parser accepts input only in the form of a sequence of octets, then the processor must ensure that the string is encoded as octets in a way that is consistent with rules used by the XML parser to detect the encoding.

A common use case for this function is to handle input documents that contain nested XML documents embedded within CDATA sections. Since the content of the CDATA section is exposed as text, the receiving query or stylesheet may pass this text to the fn:parse-xml function to create a tree representation of the nested document.

Similarly, nested XML within comments is sometimes encountered, and lexical XML is sometimes returned by extension functions, for example, functions that access web services or read from databases.

A use case arises in XSLT where there is a need to preprocess an input document before parsing. For example, an application might wish to edit the document to remove its DOCTYPE declaration. This can be done by reading the raw text using the fn:unparsed-text function, editing the resulting string, and then passing it to the fn:parse-xml function.

Examples

The expression fn:parse-xml("<alpha>abcd</alpha>") returns a newly created document node, having an alpha element as its only child; the alpha element in turn is the parent of a text node whose string value is "abcd".

The expression fn:parse-xml("<alpha><beta> </beta></alpha>", { "strip-space": true() }) returns a newly created document node, having an alpha element as its only child; the alpha element in turn is the parent of a beta element whose content is empty, as a result of whitespace stripping.

17.2.2 fn:parse-xml-fragment

Changes in 4.0 (next | previous)

  1. The $options parameter has been added.  [Issue 305 PR 1257 11 June 2024]

  2. Support for binary input has been added.  [Issue 748 PR 2013 20 May 2025]

Summary

This function takes as input an XML external entity represented as a string, and returns the document node at the root of an XDM tree representing the parsed document fragment.

Signature
fn:parse-xml-fragment(
$valueas (xs:string | xs:hexBinary | xs:base64Binary)?,
$optionsas map(*)?:= {}
) as document-node()?
Properties

This function is nondeterministic, context-dependent, and focus-independent. It depends on executable base URI.

Rules

If $value is the empty sequence, the function returns the empty sequence.

If the input is supplied as a binary value, the function detects the encoding using the same rules as the unparsed-text function, except that the special handling of media types such as text/xml and application/xml may be skipped. Otherwise, if the input is a string, any byte order mark as well as the encoding specified in an optional XML declaration should be ignored.

The input must be a namespace-well-formed external general parsed entity. More specifically, it must conform to the production rule extParsedEntXML in [Extensible Markup Language (XML) 1.0 (Fifth Edition)], it must contain no entity references other than references to predefined entities, and it must satisfy all the rules of [Namespaces in XML] for namespace-well-formed documents with the exception that the rule requiring it to be a well-formed document is replaced by the rule requiring it to be a well-formed external general parsed entity.

The input is parsed to form a sequence of nodes which become children of the new document node, in the same way as the content of any element is converted into a sequence of children for the resulting element node.

The $options argument, if present and non-empty, defines the detailed behavior of the function. The option parameter conventions apply. The options available are as follows:

record(
base-uri?as xs:anyURI,
strip-space?as xs:boolean
)
KeyValueMeaning

base-uri?

Determines the base URI. This is used as the base URI of the document node that is returned. It defaults to the static base URI of the function call.
  • Type: xs:anyURI

  • Default: static-base-uri()

strip-space?

Determines whether whitespace-only text nodes are removed from the resulting document.
  • Type: xs:boolean

  • Default: false

trueAll whitespace-only text nodes are stripped, unless they are within the scope of the attribute xml:space="preserve".
falseAll whitespace-only text nodes are preserved.

DTD validation is not invoked (an external general parsed entity cannot contain a DOCTYPE declaration.

Schema validation is not invoked, which means that the nodes in the returned document will all be untyped.

XInclude processing is not invoked.

Except as explicitly defined, the precise process used to construct the XDM instance is implementation-defined. In particular, it is implementation-defined whether an XML 1.0 or XML 1.1 parser is used.

The document URI of the returned node is absentDM.

The function is notdeterministic: that is, if the function is called twice with the same arguments, it is implementation-dependent whether the same node is returned on both occasions.

Error Conditions

A dynamic error is raised [err:FODC0006] if the content of $value is not a well-formed external general parsed entity, if it contains entity references other than references to predefined entities, or if a document that incorporates this well-formed parsed entity would not be namespace-well-formed.

Notes

See also the notes for the fn:parse-xml function.

The main differences between fn:parse-xml and fn:parse-xml-fragment are that for fn:parse-xml, the children of the resulting document node must contain exactly one element node and no text nodes, wheras for fn:parse-xml-fragment, the resulting document node can have any number (including zero) of element and text nodes among its children. An additional difference is that the text declaration at the start of an external entity has slightly different syntax from the XML declaration at the start of a well-formed document.

Note that all whitespace outside the text declaration is significant, including whitespace that precedes the first element node, unless the strip-space option is set.

One use case for this function is to handle XML fragments stored in databases, which frequently allow zero-or-more top level element nodes. Another use case is to parse the contents of a CDATA section embedded within another XML document.

Examples

The expression parse-xml-fragment("<alpha>abcd</alpha><beta>abcd</beta>") returns a newly created document node, having two elements named alpha and beta as its children; each of these elements in turn is the parent of a text node.

The expression parse-xml-fragment("He was <i>so</i> kind") returns a newly created document node having three children: a text node whose string value is "He was ", an element node named i having a child text node with string value "so", and a text node whose string value is " kind".

The expression parse-xml-fragment("") returns a document node having no children.

The expression parse-xml-fragment(" ") returns a document node whose children comprise a single text node whose string value is a single space.

The expression parse-xml-fragment(" ", { "strip-space": true() }) returns a document node having no children.

The expression parse-xml-fragment('<?xml version="1.0" encoding="utf8" standalone="yes"?><a/>') results in a dynamic error [err:FODC0006] because the standalone keyword is not permitted in the text declaration that appears at the start of an external general parsed entity. (Thus, it is not the case that any input accepted by the fn:parse-xml function will also be accepted by fn:parse-xml-fragment.)

17.2.3 fn:serialize

Changes in 4.0 (next | previous)

  1. A new parameter canonical is available to give control over serialization of XML, XHTML, and JSON.  [Issue 938 PR 2259 3 November 2025]

Summary

This function serializes the supplied input sequence $input as described in [XSLT and XQuery Serialization 3.1], returning the serialized representation of the sequence as a string.

Signature
fn:serialize(
$inputas item()*,
$optionsas (element(output:serialization-parameters) | map(*))?:= (){}
) as xs:string
Properties

This function is deterministic, context-independent, and focus-independent.

Rules

The value of the first argument $input acts as the input sequence to the serialization process, which starts with sequence normalization.

The second argument $options, if present, provides serialization parameters. These may be supplied in either of two forms:

  1. As an output:serialization-parameters element, having the format described in 3.1 Setting Serialization Parameters by Means of a Data Model Instance SER31. In this case the type of the supplied argument must match the required type element(output:serialization-parameters).

  2. As a map. In this case the type of the supplied argument must match the required type map(*)

The single-argument version of this function has the same effect as the two-argument version called with $options set to an empty sequence. This in turn is the same as the effect of passing an output:serialization-parameters element with no child elements.

The final stage of serialization, that is, encoding, is skipped. If the serializer does not allow this phase to be skipped, then the sequence of octets returned by the serializer is decoded into a string by reversing the character encoding performed in the final stage.

If the second argument is omitted, or is supplied in the form of an output:serialization-parameters element, then the values of any serialization parameters that are not explicitly specified is implementation-defined, and may depend on the context.

If the second argument is supplied as a map, then the option parameter conventions apply. In this case:

  1. Each entry in the map defines one serialization parameter.

  2. The key of the entry is an xs:string value in the cases of parameter names defined in these specifications, or an xs:QName (with non-absent namespace) in the case of implementation-defined serialization parameters.

  3. The required type of each parameter, and its default value, are defined by the following table. The default value is used when the map contains no entry for the parameter in question, and also when an entry is present, with the empty sequence as its value. The table also indicates how the value of the map entry is to be interpreted in cases where further explanation is needed.

ParameterRequired typeInterpretationDefault Value
allow-duplicate-namesxs:boolean?true means "yes", false means "no"no
byte-order-markxs:boolean?true means "yes", false means "no"no
canonicalxs:boolean?true() means "yes", false() means "no"no
cdata-section-elementsxs:QName*()
doctype-publicxs:string?Zero-length string and () both represent "absent"absent
doctype-systemxs:string?Zero-length string and () both represent "absent"absent
encodingxs:string?utf-8
escape-solidusxs:boolean?true means "yes", false means "no"yes
escape-uri-attributesxs:boolean?true means "yes", false means "no"yes
html-versionxs:decimal?5
include-content-typexs:boolean?true means "yes", false means "no"yes
indentxs:boolean?true means "yes", false means "no"no
item-delimiterxs:string?absent
json-linesxs:boolean?true means "yes", false means "no"no
json-node-output-method(xs:string | xs:QName)?See Notes 1, 2xml
media-typexs:string?(a media type suitable for the chosen method)
method(xs:string | xs:QName)?See Notes 1, 2xml
normalization-formxs:string?none
omit-xml-declarationxs:boolean?true means "yes", false means "no"yes
standalonexs:boolean?true means "yes", false means "no", () means "omit"omit
suppress-indentationxs:QName*()
undeclare-prefixesxs:boolean?true means "yes", false means "no"no
use-character-mapsmap(xs:string, xs:string)?See Note 3{}
versionxs:string?1.0

Notes to the table:

  1. The notation (A | B) represents a union type whose member types are A and B.

  2. If an xs:QName is supplied for the method or json-node-output-method options, then it must have a non-absent namespace URI. This means that system-defined serialization methods such as xml and json are defined as strings, not as xs:QName values.

  3. For the use-character-maps option, the value is a map, whose keys are the characters to be mapped (as xs:string instances), and whose corresponding values are the strings to be substituted for these characters.

Error Conditions

A type error [err:XPTY0004]XP occurs if the $options argument is present and does not match either of the types element(output:serialization-parameters)? or map(*).

Note:

This is defined as a type error so that it can be enforced via the function signature by implementations that generalize the type system in a suitable way.

If the host language makes serialization an optional feature and the implementation does not support serialization, then a dynamic error [err:FODC0010] is raised.

When the second argument is supplied as a map, and the supplied value is of the wrong type for the particular parameter, for example if the value of indent is a string rather than a boolean, then as defined by the option parameter conventions, a type error [err:XPTY0004]XP is raised. If the value is of the correct type, but does not satisfy the rules for that parameter defined in [XSLT and XQuery Serialization 3.1], then a dynamic error [err:SEPM0016]SER31 is raised. (For example, this occurs if the map supplied to use-character-maps includes a key that is a string whose length is not one (1)).

If any serialization error occurs, including the detection of an invalid value for a serialization parameter as described above, this results in the fn:serialize call failing with a dynamic error.

Notes

One use case for this function arises when there is a need to construct an XML document containing nested XML documents within a CDATA section (or on occasions within a comment). See fn:parse-xml for further details.

Another use case arises when there is a need to call an extension function that expects a lexical XML document as input.

Another use case for this function is serializing instances of the data model into a human readable format for the purposes of debugging. Using the 10 Adaptive Output Method SER31 by specifying it as the output method defined in the second argument via output:serialization-parameters, allows for serializing any valid XDM instance without raising a serialization error.

There are also use cases where the application wants to post-process the output of a query or transformation, for example by adding an internal DTD subset, or by inserting proprietary markup delimiters such as the <% ... %> used by some templating languages.

The ability to specify the serialization parameters in an output:serialization-parameters element provides backwards compatibility with the 3.0 version of this specification; the ability to use a map takes advantage of new features in the 3.1 version. The default parameter values are implementation-defined when an output:serialization-parameters element is used (or when the argument is omitted), but are fixed by this specification in the case where a map (including an empty map) is supplied for the argument.

Examples
Variables
let $params := <output:serialization-parameters 
    xmlns:output="http://www.w3.org/2010/xslt-xquery-serialization">
  <output:omit-xml-declaration value="yes"/>
</output:serialization-parameters>
let $data := <a b="3"/>

Given the variables:

The following call might produce the output shown:

Expression:

serialize($data, $params)

Result:

'<a b="3"/>'

The following call would also produce the output shown (though the second argument could equally well be supplied as an empty map ({}), since both parameters are given their default values):

Expression:
serialize(
  $data,
  { "method": "xml", "omit-xml-declaration": true() }
)
Result:
'<a b="3"/>'
Expression:

serialize({ "a": "AB", "b": "BC" }, { "method": "adaptive" })

Result:

'{"a":"AB","b":"BC"}'

Expression:
serialize(
  array { "a", 3, attribute test { "true" } },
  { "method": "adaptive" 
})
Result:
'["a",3,test="true"]'

17.2.5 fn:xsd-validator

Changes in 4.0 (next | previous)

  1. New in 4.0

Summary

Given an XSD schema, delivers a function item that can be invoked to validate a document or element node against this schema.

Signature
fn:xsd-validator(
$optionsas map(*)?:= {}
) as function((document-node(*) | element(*) | attribute(*))?) as record(is-valid as xs:boolean, typed-node? as node(), error-details? as record(*)*)
Properties

This function is deterministic, context-dependent, and focus-independent.

Rules

The fn:xsd-validator function returns a function item that can be used to validate a document node or an element node with respect to a supplied schema.

The details of how the schema is assembled, and the way it is used, are defined by the supplied $options. If the $options argument is absent or empty, the effect is to use the schema components from the static context of the call on fn:xsd-validator. In the general case, however, the schema used for validation may include components from any or all of the following:

  • The static context of the function call

  • Explicitly supplied schema documents

  • Schema components referenced in xsi:schemaLocation and xsi:noNamespaceSchemaLocation attributes within the instance document being validated.

More details of schema assembly appear below. Taken together, the assembled components must constitute a valid schema.

The function is designed to separate the process of assembling a schema from the process of performing instance validation. However, if the schema is to include components identified in xsi:schemaLocation and xsi:noNamespaceSchemaLocation attributes, then the process of assembling the schema cannot be completed until the instance document is available.

The options recognized are as follows. The option parameter conventions apply.

record(
trusted?as xs:boolean,
use-imported-schema?as xs:boolean,
schema?as element(xs:schema)*,
target-namespace?as xs:anyURI*,
schema-location?as xs:anyURI*,
use-xsi-schema-location?as xs:boolean,
xsd-version?as xs:decimal,
validation-mode?as xs:string,
type?as xs:QName?,
return-typed-node?as xs:boolean,
return-error-details?as xs:boolean
)
KeyValueMeaning

trusted?

Indicates whether the validation process may cause external resources to be fetched (including, for example, documents referenced using the schema-location property, or xsi:schemaLocation attributes within the document being validated).
  • Type: xs:boolean

  • Default: false()

trueThe validation process may retrieve external resources.
falseThe validation process must not retrieve any external resources unless access to these resources has been explicitly enabled.

use-imported-schema?

If true, the schema to be used for validation includes the schema components available in the static context of the function call. If false, these components are not used.
  • Type: xs:boolean

  • Default: true

schema?

A list of XDM nodes containing XSD schema documents to be used for validation.
  • Type: element(xs:schema)*

  • Default: ()

target-namespace?

A list of target namespaces identifying schema components to be used for validation. The way in which the processor locates schema components for the specified target namespaces is implementation-defined. A zero-length string denotes a no-namespace schema.
  • Type: xs:anyURI*

  • Default: ()

schema-location?

A list of locations of XSD schema documents to be used to assemble a schema. Any relative URIs are resolved relative to the base URI of the function call. Access to the schema documents at these locations is allowed regardless of the value of the trusted option; access to indirectly referenced schema documents (for example, using xs:include is allowed only if the trusted option is set to true.
  • Type: xs:anyURI*

  • Default: ()

use-xsi-schema-location?

If true, the schema to be used for validation includes any schema documents referenced by xsi:schemaLocation or xsi:noNamespaceSchemaLocation attributes in the instance document being validated. If false, these attributes are ignored.
  • Type: xs:boolean

  • Default: false

xsd-version?

Set to the decimal value 1.0 or 1.1 to indicate which version of XSD is to be used. The default is implementation-defined. A processor may use a later version of XSD than the version requested, but must not use an earlier version.
  • Type: xs:decimal

validation-mode?

The validation mode.
  • Type: xs:string

strictValidates the input using the element or attribute declaration for the operand node. This element or attribute declaration must exist. This is the default when the type option is absent.
laxValidates the input using the element or attribute declaration for the operand node, if it exists.
by-typeValidates the input using the supplied governing type. This is the default when the type option is present.

type?

Establishes the governing type for validation. The type must be present in the assembled schema.
  • Type: xs:QName?

return-typed-node?

If true, the result of the generated validation function, when validation is successful, includes the property typed-node which contains a copy of the target node augmented with type annotations and expanded default values. If false, the typed node is not included in the result. If a node containing type annotations is to be returned, then the schema used for validation must be compatible with all other schemas used within the same query or stylesheet, as described in [XQuery and XPath Data Model (XDM) 4.0] section 4.1.2 Schema Consistency; this is to ensure that the type annotations in the validated document have a consistent interpretation.
  • Type: xs:boolean

  • Default: true

return-error-details?

If true, the result of the generated validation function, when validation is unsuccessful, includes detailed information about the nature of the validity errors that were found. If false, the result only includes an indication that the document was invalid. Note that setting the value to false means that validation can complete as soon as the first error is found.
  • Type: xs:boolean

  • Default: false

The first task of the function is to assemble a schema (that is, a collection of schema components). Schema components can come from a number of sources, and a schema can be assembled from more than one source, provided that the total collection of components comprises a valid schema: the main thing that will prevent this is if two sources contain conflicting definitions of the same named component.

  • The default is to use the in-scope schema components from the static context of the function call.

  • Instead, or in addition, schema components may be loaded explictly for this validator. Supplementary schema components may be requested in a number of ways:

    • The schema-location option can specify one or more URIs that are interpreted as locations for source XSD schema documents, which are then assembled into a schema as described in the XSD specifications.

    • The schema option can be used to identify one or more xs:schema element nodes holding source schema documents. This allows a schema to be constructed dynamically by the application, or to be held as a global variable in the source code of a query or stylesheet module.

    • The target-namespace option can be used to supply the target namespaces of additional schema components that are known to the system or that are made available using some external mechanism. For example, the system might have built-in schemas for common namespaces such as the xml, fn, or xlink namespaces, or it might have a mechanism allowing schemas for a particular namespace to be registered using an external API or configuration mechanism.

  • The use-xsi-schema-location also allows the application to request that schema documents referenced from xsi:schemaLocation or xsi:noNamespaceSchemaLocation attributes should be included in the schema. By default these attributes are ignored.

  • It is acceptable to assemble a schema from more than one of these sources. In addition, any of these sources can bring in additional components by the use of the XSD directives xsl:include and xsl:import. The important constraint is that the result should be a valid schema. This will only be the case if the sources used to assemble the schema are compatibleDM with each other: see [XQuery and XPath Data Model (XDM) 4.0] section 4.1.2 Schema Consistency.

  • The XSD specification allows a schema to be used for validation even when it contains unresolved references to absent schema components. It is implementation-defined whether this function allows the schema to be incomplete in this way. For example, some processors might allow validation using a schema in which an element declaration contains a reference to a type declaration that is not present in the schema, provided that the element declaration is never needed in the course of a particular validation episodes.

Having assembled a schema, the next task is to validate a supplied node (and the subtree rooted at that node).

Note:

This description is a deliberate simplification. If the use-xsi-schema-location option is true, then assembly of the schema is not completed until the instance document is available, and in practice overlaps with the validation process.

The xsd-validator function returns a function item (call it V) with the following characteristics:

  • V has an arity of one. Call the value of the supplied argument $target. The required type of $target is (document-node(*) | element(*) | attribute(*))?: that is, it accepts either a well-formed document node, or an element node, or an attribute node, or an empty sequence.

  • If the argument is an empty sequence then the result of V is also an empty sequence.

  • In other cases, the result of a call on V is a record containing the following fields:

    • is-valid as xs:boolean. This field is always present, and indicates whether the supplied $target node was found to be valid against the schema. The value is true if either (a) the validation outcome was valid, or (b) lax validation was requested and the validation outcome was notKnown. In other cases it is false.

    • typed-node as (document-node(*) | element(*) | attribute(*)). This field is present only when (a) the option return-typed-node was set (explicitly or implicitly) to true, and (b) the value of the is-valid field is true. It represents the root of a tree that is a deep copy of the input tree, augmented with type annotations and default values.

    • error-details as map(*)*. This field is present only when (a) the option return-error-details was set to true, and (b) the supplied document was found to be invalid. The value is a sequence of maps, each containing details of one invalidity that was found. The precise details of the invalidities are implementation-defined, but they may include the following fields, if the information is available:

      • message. A string containing the text of an error message, intended for a human reader.

      • rule. A reference to the rule in the XSD specification that was violated. This is a string comprising four parts separated by the character U+007C (VERTICAL BAR, |) :

        • "1.0" or "1.1" indicating whether the reference is to the XSD 1.0 or 1.1 specification.

        • "1" or "2" indicating whether the reference is to part 1 or part 2 of the specification.

        • The name of the validation rule (for example "Datatype Valid").

        • The clause number within that validation rule (for example "2.3").

        For example, if an attribute is declared to be of type xs:integer, but the actual value is not in the lexical space of xs:integer, the value of rule might be "1.1|2|Datatype Valid|2.1".

      • node. The node that was found to be invalid. Note that when a containing element C is invalid because a child element D is not allowed by its content model, the invalid node is C, not D.

      • error-node. The node whose presence led to detection of the invalidity. In the above example, this would be D.

      • error-uri. The URI of the XML entity in which the error was detected.

      • line-number. The line number where the error was detected, within its external entity.

      • column-number. The column number where the error was detected, within the error line number.

  • The validation is performed as described in 17.2.4 XSD validation, with the assembled schema as the effective schema and $target as the operand node.

  • If the use-xsi-schema-location option is true and a failure occurs processing an xsi:schemaLocation or xsi:noNamespaceSchemaLocation attribute (for example, because a schema document cannot be retrieved, or because the referenced schema document is invalid, or because it is incompatible with other schema components) this is treated as an invalidity, not as a dynamic error: V returns successfully with is-valid set to false.

  • The function V may fail with a dynamic error if it is not possible to determine whether or not the instance document is valid. This may happen, for example, if processor-defined limits are exceeded.

Error Conditions

A dynamic error is raised [err:FODC0009] if the processor is not schema-aware, or if no schema processor with the required capabilities (such as XSD 1.1 support) is available.

A dynamic error is raised [err:FODC0015] if it is not possible to assemble a valid and consistent schema.

Notes

Both XQuery and XSLT provide capabilities for XSD-based schema validation in earlier versions of the specifications, and those are retained in 4.0. This function provides additional capability:

  • It is possible to control validation more precisely, through a wider range of options;

  • It is possible to validate different instance documents against different schemas;

  • Information about any invalidities is made available to the application, rather than simply causing a dynamic error;

  • The capability is provided by means of a function rather than custom syntax, making it easier to integrate into an application.

  • The capability is available through XPath alone, and therefore with host languages other than XQuery and XSLT.

Three possible ways of using the function include:

  • To simply test whether or not a document is valid against a schema, set the options return-typed-node and return-error-details to false, and simply test the value of the is-valid field returned when the validation function is called.

  • To obtain a typed XDM tree from an input document that is expected to be valid, set the option return-typed-node to true. On return from the validation function, test the value of the is-valid field; call fn:error if the value is false; otherwise use the typed-node property of the result. The main benefit of using a typed XDM tree is that it allows static type checking of path expressions: this benefit only applies when the schema used for validation is the imported schema used in the static context. However, there are cases where validation against a different schema is appropriate, for example when validating the result of one query or transformation that is to be used as input to another.

  • To validate an input document and provide feedback to the document author about any validity problems that were found, set return-error-details to true. If the result of the validation function has is-valid = false(), process the returned error-details. The information available for this part of the processing may not be 100% interoperable, though with care it should be possible to write the query in such a way that it works with different processors.

The validation process is explained in more detail in the XQuery ([XQuery 4.0: An XML Query Language] section 4.25 Validate Expressions) and XSLT ([XSL Transformations (XSLT) Version 4.0] section 25.4 Validation) specifications.

The function has no effect on the static context. Schemas loaded using this function, either directly or via the effect of xsi:schemaLocation and xsi:noNamespaceSchemaLocation attributes, are not added to the static context and have no effect on any other validation episodes. A processor may cache schema components to reduce the cost of processing the same schema repeatedly, but this has no observable effect other than on performance.

Examples
Expression:
let $schema := 
  <xs:schema>
    <xs:element name="distance" type="xs:decimal"/>
  </xs:schema>
let $validator := xsd-validator({'schema': $schema})
return ($validator(<distance>8.5</distance>)?is-valid,
        $validator(<distance>8.5km</distance>)?is-valid)
Result:
true(), false()
Expression:
let $schema := 
  <xs:schema>
    <xs:element name="distance" type="xs:decimal"/>
  </xs:schema>
let $validator := xsd-validator({'schema': $schema})
let $typed-result := $validator(<distance>8.5</distance>)?typed-node
return $typed-result instance of element(distance, xs:decimal)
Result:
true()

17.3 Functions on HTML Data

Changes in 4.0 (next | previous)

  1. A new function is available for processing input data in HTML format.   [Issues 74 850 1799 1889 1891 PRs 259 956 10 January 2023]

This function converts between the lexical representation of HTML and the XDM tree representation.

FunctionMeaning
fn:parse-htmlThis function takes as input an HTML document, and returns the document node at the root of an XDM tree representing the parsed document.
fn:html-docReads an external resource containing HTML, and returns the result of parsing the resource as HTML.

17.3.2 fn:parse-html

Changes in 4.0 (next | previous)

  1. New in 4.0  [Issues 74 850 1799 1889 1891 2210 PRs 259 956 10 January 2023]

Summary

This function takes as input an HTML document, and returns the document node at the root of an XDM tree representing the parsed document.

Signature
fn:parse-html(
$valueas (xs:string | xs:hexBinary | xs:base64Binary)?,
$optionsas map(*)?:= {}
) as document-node(*:html)?
Properties

This function is nondeterministic, context-independent, and focus-independent.

Rules

If $value is the empty sequence, the function returns the empty sequence.

In other cases, $value is expected to contain an HTML document supplied either as a string or a binary value.

The entries that may appear in the $options map are as follows:

record(
encoding?as xs:string,
fail-on-error?as xs:boolean
)
KeyValueMeaning

encoding?

The character encoding to use to decode a sequence of octets that represents an HTML document.

  • Type: xs:string

fail-on-error?

Indicates whether the function should fail with a dynamic error if the input is not syntactically valid.

  • Type: xs:boolean

  • Default: false

false Parsing errors should be handled as described in [HTML: Living Standard] section 13.2.2, Parse Errors.
true A parsing error should result in the function failing with a dynamic error.

The option parameter conventions apply.

If $value is not the empty sequence, an input byte stream is constructed as follows:

  1. If $value is an xs:string, then in principle no decoding is needed. Conceptually, however, the HTML parsing algorithm always starts by decoding an octet stream. The string is therefore first encoded using UTF-8, and the resulting octet stream is then passed to the HTML parser with a known definite encoding of UTF-8, as described in [HTML: Living Standard] section 13.2.3.1, Parsing with a known character encoding.

    If the first codepoint of the string is U+FEFF, this should be stripped, since it might otherwise lead to an incorrect encoding inference.

  2. If the type of $value is a sequence of octets (xs:hexBinary or xs:base64Binary) the encoding of the input byte stream is determined in a way consistent with [HTML: Living Standard] section 13.2.3.2, Determining the character encoding:

    1. The encoding key of $options is interpreted in step 2 of Determining the character encoding as the user instructing the user agent to override the document’s character encoding with the specified encoding.

    2. If the encoding key of $options is not specified, step 2 of Determining the character encoding is skipped.

  1. Tokenizing the byte stream according to the HTML parsing algorithm as described in [HTML: Living Standard] section 13.2.5, Tokenization.

  2. Constructing a HTMLDocument object for HTML documents, or an XMLDocument for XML/XHTML documents as described in [HTML: Living Standard] section 13.2.6, Tree construction.

  3. Building an XDM representation of the HTMLDocument or XMLDocument according to the rules in 17.3.1 XDM Mapping from HTML DOM Nodes.

The implementation should process any input HTML that adheres to the current practice of mainstream web browsers, as this evolves over time. Since this is defined by a “living standard” (see [HTML: Living Standard]), no specific version is prescribed. An implementation may define additional options to control aspects of the HTML parsing algorithm, including the selection of a specific HTML parsing library; it may also provide options to process alternative HTML versions or dialects.

The implementation should recognize and process XHTML (referred to in [HTML: Living Standard] as the XML concrete syntax of HTML).

The function is nondeterministic with respect to node identity: that is, if the function is called twice with the same arguments, it is implementation-dependent whether the same node is returned on both occasions.

Error Conditions

A dynamic error is raised [err:FODC0011] if the content of $value is not a well-formed HTML document.

Notes

If the HTML parser accepts a string as the input then that may be used directly when $value is an xs:string instead of converting the string to a sequence of octets in an implementation-dependent encoding. The HTML parser must not perform character encoding processing on that input, treating the HTML string as being in a known character encoding that matches the encoding of the string.

The WHATWG Encoding specification defines the ISO 8859-1 (latin1) and ASCII encodings as aliases of the windows-1252 encoding.

Examples

The expression parse-html(()) returns ().

The expression parse-html("<p>Hello</p>") returns an XDM document node equivalent to the result of parsing the XML <html xmlns='http://www.w3.org/1999/xhtml'><head/><body><p>Hello</p></body></html>

The expression parse-html("<p>Hi</p>", method:="html") is equivalent to parse-html("<p>Hi</p>").

17.3.3 fn:html-doc

Changes in 4.0 (next | previous)

  1. New in 4.0  [Issue 748 PR 2013 20 May 2025]

Summary

Reads an external resource containing HTML, and returns the result of parsing the resource as HTML.

Signature
fn:html-doc(
$sourceas xs:string?,
$optionsas map(*)?:= {}
) as document-node(*:html)?
Properties

This function is deterministic, context-dependent, and focus-independent. It depends on executable base URI.

Rules

If the second argument is omitted or an empty sequence, the result is the same as calling the two-argument form with an empty map as the value of the $options argument.

The effect of the two-argument function call fn:html-doc($H, $M)is equivalent to the function composition fn:unparsed-binary($H) => fn:parse-html($M).

If $source is the empty sequence, the function returns the empty sequence.

Note:

The ability to access external resources depends on whether the calling code is trustedXP.

Error Conditions

The function may raise any error defined for the fn:unparsed-binary or fn:parse-html functions.

17.4 Functions on JSON Data

The functions listed in this section parse or serialize JSON data.

JSON is a popular format for exchange of structured data on the web: it is specified in [RFC 7159]. This section describes facilities allowing JSON data to be converted to and from XDM values.

This specification describes two ways of representing JSON data losslessly using XDM constructs. The first method uses XDM maps to represent JSON objects, and XDM arrays to represent JSON arrays. The second method represents all JSON constructs using XDM element and attribute nodes.

FunctionMeaning
fn:parse-jsonParses input supplied in the form of a JSON text, returning the results typically in the form of a map or array.
fn:json-docReads an external resource containing JSON, and returns the result of parsing the resource as JSON.
fn:json-to-xmlParses a string supplied in the form of a JSON text, returning the results in the form of an XML document node.
fn:xml-to-jsonConverts an XML tree, whose format corresponds to the XML representation of JSON defined in this specification, into a string conforming to the JSON grammar.

Note also:

  • The function fn:serialize has an option to generate JSON output from a structure of maps and arrays.

  • The function fn:element-to-map enables arbitrary XML node trees to be converted to trees of maps and arrays suitable for serializing as JSON.

17.4.4 fn:parse-json

Changes in 4.0 (next | previous)

  1. The rules regarding use of non-XML characters in JSON texts have been relaxed.  [Issue 414 PR 546 25 July 2023]

  2. An option is provided to control how the JSON null value should be handled.  [Issue 960 PR 1028 20 February 2024]

  3. An option is provided to control how JSON numbers should be formatted.  [Issues 973 1037 PRs 975 1058 1246 12 March 2024]

  4. The default for the escape option has been changed to false. The 3.1 specification gave the default value as true, but this appears to have been an error, since it was inconsistent with examples given in the specification and with tests in the test suite.  [Issue 1555 PR 1565 11 November 2024]

  5. The order of entries in maps is retained.  [Issue 1651 PR 1703 14 January 2025]

Summary

Parses input supplied in the form of a JSON text, returning the results typically in the form of a map or array.

Signature
fn:parse-json(
$valueas xs:string?,
$optionsas map(*)?:= {}
) as item()?
Properties

This function is deterministic, context-independent, and focus-independent.

Rules

If the second argument is omitted or an empty sequence, the result is the same as calling the two-argument form with an empty map as the value of the $options argument.

The first argument is a JSON text as defined in [RFC 7159], in the form of a string or binary value. The function parses this input to return an XDM value.

If $value is the empty sequence, the function returns the empty sequence.

Note:

If the input is "null", the result will also be an empty sequence.

The $options argument can be used to control the way in which the parsing takes place. The option parameter conventions apply.

The entries that may appear in the $options map are as follows:

record(
liberal?as xs:boolean,
duplicates?as xs:string,
escape?as xs:boolean,
fallback?as (fn(xs:string) as xs:anyAtomicType)?,
null?as item()*,
number-parser?as (fn(xs:untypedAtomic) as item()?)?
)
KeyValueMeaning

liberal?

Determines whether deviations from the syntax of RFC7159 are permitted.
  • Type: xs:boolean

  • Default: false

false The input must consist of an optional byte order mark (which is ignored) followed by a string that conforms to the grammar of JSON-text in [RFC 7159]. An error must be raised [err:FOJS0001] if the input does not conform to the grammar.
true The input may contain deviations from the grammar of [RFC 7159], which are handled in an implementation-defined way. (Note: some popular extensions include allowing quotes on keys to be omitted, allowing a comma to appear after the last item in an array, allowing leading zeroes in numbers, and allowing control characters such as tab and newline to be present in unescaped form.) Since the extensions accepted are implementation-defined, an error may be raised [err:FOJS0001] if the input does not conform to the grammar.

duplicates?

Determines the policy for handling duplicate keys in a JSON object. To determine whether keys are duplicates, they are compared using the Unicode codepoint collation, after expanding escape sequences, unless the escape option is set to true, in which case keys are compared in escaped form.
  • Type: xs:string

  • Default: use-first

reject An error is raised [err:FOJS0003] if duplicate keys are encountered.
use-first If duplicate keys are present in a JSON object, all but the first of a set of duplicates are ignored.
use-last If duplicate keys are present in a JSON object, all but the last of a set of duplicates are ignored.

escape?

Determines whether special characters are represented in the XDM output in backslash-escaped form.
  • Type: xs:boolean

  • Default: false

false Any permitted character in the input, whether or not it is represented in the input by means of an escape sequence, is represented as an unescaped character in the result. Any other character or codepoint (for example, an unpaired surrogate) is passed to the fallback function as described below; in the absence of a fallback function, it is replaced by U+FFFD (REPLACEMENT CHARACTER, ) .
true JSON escape sequences are used in the result to represent special characters in the JSON input, as defined below, whether or not they were represented using JSON escape sequences in the input. The characters that are considered “special” for this purpose are:
  • all codepoints in the range U+0000 (NULL) to U+001F (IS1) or U+007F (DELETE) to U+009F (APC) ;

  • all codepoints that do not represent permitted characters, including codepoints representing unpaired surrogates;

  • the character U+005C (REVERSE SOLIDUS, BACKSLASH, \) itself.

Such characters are represented using a two-character escape sequence where available (for example, \t), or a six-character escape sequence otherwise (for example \uDEAD). Characters other than these are not escaped in the result, even if they were escaped in the input.

fallback?

Provides a function which is called when the input contains an escape sequence that represents a character that is not a permitted character. It is an error to supply the fallback option if the escape option is present with the value true.
  • Type: (fn(xs:string) as xs:anyAtomicType)?

  • Default: fn { char(0xFFFD) }

User-supplied function The function is called when the JSON input contains character that is not a permitted character It is called once for any surrogate that is not properly paired with another surrogate. The untyped atomic item supplied as the argument will always be a two- or six-character escape sequence, starting with a backslash, that conforms to the rules in the JSON grammar (as extended by the implementation if liberal:true() is specified): for example \b or \uFFFF or \uDEAD.

By default, the escape sequence is replaced with the Unicode REPLACEMENT CHARACTER. The function is not called for an escape sequence that is invalid against the grammar (for example \x0A). The string, which results from invoking fn:string on the result of the function, is inserted into the result in place of the invalid character. The function also has the option of raising a dynamic error by calling fn:error.

null?

Determines how the JSON null value should be represented.
  • Type: item()*

  • Default: ()

Value The supplied XDM value is used to represent the JSON null value. The default representation of null is an empty sequence, which works well in cases where setting a property of an object to null has the same meaning as omitting the property. It works less well in cases where null is used with some other meaning, because expressions such as the lookup operator ? flatten the result to a single sequence of items, which means that any entries whose value is an empty sequence effectively disappear. The property can be set to any XDM value; a suggested value is the xs:QName value fn:QName("http://www.w3.org/2005/xpath-functions", "null"), which is recognized by the JSON serialization method as representing the JSON value null.

number-parser?

Determines how numeric values should be processed.
  • Type: (fn(xs:untypedAtomic) as item()?)?

  • Default: xs:double#1

User-supplied function The supplied function is called to process the string value of any JSON number in the input. By default, numbers are processed by converting to xs:double using the XPath casting rules. Supplying the value xs:decimal#1 will instead convert to xs:decimal (which potentially retains more precision, but disallows exponential notation), while supplying a function that casts to (xs:decimal | xs:double) will treat the value as xs:decimal if there is no exponent, or as xs:double otherwise. Supplying the value fn:identity#1 causes the value to be retained unchanged as an xs:untypedAtomic. If the liberal option is false (the default), then the supplied number-parser is called if and only if the value conforms to the JSON grammar for numbers (for example, a leading plus sign and redundant leading zeroes are not allowed). If the liberal option is true then it is also called if the value conforms to an implementation-defined extension of this grammar.

The various structures that can occur in JSON are transformed recursively to XDM values as follows:

  1. A JSON object is converted to a map. The entries in the map correspond to the key/value pairs in the JSON object. The key is always of type xs:string; the associated value may be of any type, and is the result of converting the JSON value by recursive application of these rules. For example, the JSON text { "x": 2, "y": 5 } is transformed to the value { "x": 2, "y": 5 }.

    If duplicate keys are encountered in a JSON object, they are handled as determined by the duplicates option defined above.

    The order of entries is retained.

  2. A JSON array is transformed to an array whose members are the result of converting the corresponding member of the array by recursive application of these rules. For example, the JSON text [ "a", "b", null ] is transformed (by default) to the value [ "a", "b", () ].

  3. A JSON string is converted to an xs:string value. The handling of special characters depends on the escape and fallback options, as described in the table above.

  4. A JSON number is processed using the function supplied in the number-parser option; by default it is converted to an xs:double value using the rules for casting from xs:string to xs:double.

  5. The JSON boolean values true and false are converted to the corresponding xs:boolean values.

  6. The JSON value null is converted to the value given by the null option, which defaults to an empty sequence.

Error Conditions

A dynamic error [err:FOJS0001] occurs if the value of $value does not conform to the JSON grammar, unless the option "liberal":true() is present and the processor chooses to accept the deviation.

A dynamic error [err:FOJS0003] occurs if the option "duplicates": "reject" is present and the value of $value contains a JSON object with duplicate keys.

A dynamic error [err:FOJS0005] occurs if the $options map contains an entry whose key is defined in this specification and whose value is not valid for that key, or if it contains an entry with the key fallback when the option "escape":true() is also present.

Notes

The result of the function will be an instance of one of the following types. An instance of test (or in XQuery, typeswitch) can be used to distinguish them:

  • map(xs:string, item()?) for a JSON object

  • array(item()?) for a JSON array

  • xs:string for a JSON string

  • xs:double for a JSON number

  • xs:boolean for a JSON boolean

  • empty-sequence() for a JSON null (or for empty input)

If the source of the JSON input is a resource accessible by URI, then it may be preferable to use the fn:json-doc function. If the source is a binary value (xs:hexBinary or xs:base64Binary) then this can first be decoded as a string using the functions bin:infer-encoding and bin:decode-string.

If the input starts with a byte order mark, this function ignores it. The byte order mark may have been added to the data stream in order to facilitate decoding of an octet stream to a character string, but since this function takes a character string as input, the byte order mark serves no useful purpose.

The possibility of the input containing characters that are not valid in XML (for example, unpaired surrogates) arises only when such characters are expressed using JSON escape sequences. This is because the input to the function is an instance of xs:string, which by definition (see [XQuery and XPath Data Model (XDM) 4.0] section 4.1.5 XML and XSD Versions) cannot contain unpaired surrogates.

The serializer provides an option to output data in json-lines format. This is a format for structured data containing one JSON value (usually but not necessarily a JSON object) on each line. There is no corresponding option to parse json-lines input, but this can be achieved using the expression unparsed-text-lines($uri) =!> parse-json().

Examples
Expression:

parse-json('{ "x": 1, "y": [ 3, 4, 5 ] }')

Result:

{ "x": 1e0, "y": [ 3e0, 4e0, 5e0 ] }

Expression:

parse-json('"abcd"')

Result:

"abcd"

Expression:

parse-json('{ "x": "\\", "y": "\u0025" }')

Result:

{ "x": "\", "y": "%" }

Expression:
parse-json(
  '{ "x": "\\", "y": "\u0025" }',
  { 'escape': true() }
)
Result:
{ "x": "\\", "y": "%" }
Expression:
parse-json(
  '{ "x": "\\", "y": "\u0000" }'
)
Result:
{ "x": "\", "y": char(0xFFFD) }
Expression:
parse-json(
  '{ "x": "\\", "y": "\u0000" }',
  { 'escape': true() }
)
Result:
{ "x": "\\", "y": "\u0000" }
Expression:
parse-json(
  '{ "x": "\\", "y": "\u0000" }',
  { 'fallback': fn($s) { '[' || $s || ']' } }
)
Result:
{ "x": "\", "y": "[\u0000]" }
Expression:
parse-json(
  "1984.2",
  { 'number-parser': fn { xs:integer(round(.)) } }
)
Result:
1984
Expression:
parse-json(
  '[ 1, -1, 2 ]',
  { 'number-parser': fn  { boolean(. >= 0) } }
)
Result:
[ true(), false(), true() ]
Expression:
parse-json('[ "a", null, "b" ]',
  { 'null': #fn:null }
)
Result:
[ "a", #fn:null, "b" ]

17.4.5 fn:json-doc

Changes in 4.0 (next | previous)

  1. Additional options are available, as defined by fn:parse-json.

  2. It is no longer automatically an error if the input contains a codepoint that is not valid in XML. Instead, the codepoint must be a permitted character. The set of permitted characters is implementation-defined, but it is recommended that all Unicode characters should be accepted.  [Issue 414 PR 546 25 July 2023]

Summary

Reads an external resource containing JSON, and returns the result of parsing the resource as JSON.

Signature
fn:json-doc(
$sourceas xs:string?,
$optionsas map(*)?:= {}
) as item()?
Properties

This function is deterministic, context-dependent, and focus-independent. It depends on executable base URI.

Rules

If the second argument is omitted or an empty sequence, the result is the same as calling the two-argument form with an empty map as the value of the $options argument.

The effect of the two-argument function call fn:json-doc($H, $M)is equivalent to the function composition fn:unparsed-text($H) => fn:parse-json($M), except that:

  • The function may accept a resource in any encoding. [RFC 7159] requires UTF-8, UTF-16, or UTF-32 to be accepted, but it is not an error if a different encoding is used. Unless external encoding information is available, the function must assume that the encoding is one of UTF-8, UTF-16, or UTF-32, and must distinguish these cases by examination of the initial octets of the resource.

  • Having established the encoding, the function must accept any codepoint that can validly occur in a JSON text, with the exception of unpaired surrogates.

If $source is the empty sequence, the function returns the empty sequence.

Note:

The ability to access external resources depends on whether the calling code is trustedXP.

Error Conditions

The function may raise any error defined for the fn:unparsed-text or fn:parse-json functions.

Notes

An initial byte order mark is dropped, as with the fn:unparsed-text function.

If the input cannot be decoded (that is, converted into a sequence of Unicode codepoints, which may or may not represent characters), then a dynamic error occurs as with the fn:unparsed-text function.

If the input can be decoded, then the possibility still arises that the resulting sequence of codepoints includes codepoints that are not permitted characters. Such codepoints are translated into JSON escape sequences (for example, \uFFFF), and the JSON escape sequence is then passed to the fallback function specified in the $options argument, which in turn defaults to a function that returns the Unicode REPLACEMENT CHARACTER (xFFFD).

The function may accept a resource in any encoding. [RFC 7159] requires UTF-8, UTF-16, or UTF-32 to be accepted, but it is not an error if a different encoding is used. The function detects the encoding using the same rules as the unparsed-text function, except that the special handling of media types such as text/xml and application/xml may be skipped.

17.4.6 fn:json-to-xml

Summary

Parses a string supplied in the form of a JSON text, returning the results in the form of an XML document node.

Signature
fn:json-to-xml(
$valueas xs:string?,
$optionsas map(*)?:= {}
) as document-node(fn:*)?
Properties

This function is nondeterministic, context-dependent, and focus-independent. It depends on executable base URI.

Rules

If the second argument is omitted or an empty sequence, the result is the same as calling the two-argument form with an empty map as the value of the $options argument.

The first argument is a JSON text as defined in [RFC 7159], in the form of a string. The function parses this string to return an XDM node.

If $value is an empty sequence, the function returns the empty sequence.

The $options argument can be used to control the way in which the parsing takes place. The option parameter conventions apply.

The entries that may appear in the $options map are as follows:

record(
liberal?as xs:boolean,
duplicates?as xs:string,
validate?as xs:boolean,
escape?as xs:boolean,
fallback?as (fn(xs:string) as xs:anyAtomicType)?,
number-parser?as (fn(xs:untypedAtomic) as item()?)?
)
KeyValueMeaning

liberal?

Determines whether deviations from the syntax of RFC7159 are permitted.
  • Type: xs:boolean

  • Default: false

false The input must consist of an optional byte order mark (which is ignored) followed by a string that conforms to the grammar of JSON-text in [RFC 7159]. An error must be raised (see below) if the input does not conform to the grammar.
true The input may contain deviations from the grammar of [RFC 7159], which are handled in an implementation-defined way. (Note: some popular extensions include allowing quotes on keys to be omitted, allowing a comma to appear after the last item in an array, allowing leading zeroes in numbers, and allowing control characters such as tab and newline to be present in unescaped form.) Since the extensions accepted are implementation-defined, an error may be raised (see below) if the input does not conform to the grammar.

duplicates?

Determines the policy for handling duplicate keys in a JSON object. To determine whether keys are duplicates, they are compared using the Unicode codepoint collation, after expanding escape sequences, unless the escape option is set to true, in which case keys are compared in escaped form.
  • Type: xs:string

  • Default: If validate is true then reject, otherwise retain.

reject An error is raised [err:FOJS0003] if duplicate keys are encountered.
use-first If duplicate keys are present in a JSON object, all but the first of a set of duplicates are ignored.
retain If duplicate keys are present in a JSON object, the XML result of the function will also contain duplicates (making it invalid against the schema). This value is therefore incompatible with the option validate=true [err:FOJS0005]

validate?

Determines whether the generated XML tree is schema-validated.
true Indicates that the resulting XDM instance must be typed; that is, the element and attribute nodes must carry the type annotations that result from validation against the schema given at D.2 Schema for the result of fn:json-to-xml, or against an implementation-defined schema if the liberal option has the value true.
false Indicates that the resulting XDM instance must be untyped.

escape?

Determines whether special characters are represented in the XDM output in backslash-escaped form.
  • Type: xs:boolean

  • Default: false

false All characters in the input that are valid in the version of XML supported by the implementation, whether or not they are represented in the input by means of an escape sequence, are represented as unescaped characters in the result. Any characters or codepoints that are not valid XML characters (for example, unpaired surrogates) are passed to the fallback function as described below; in the absence of a fallback function, they are replaced by the character U+FFFD (REPLACEMENT CHARACTER, ) . The attributes escaped and escaped-key will not be present in the XDM output.
true JSON escape sequences are used in the result to represent special characters in the JSON input, as defined below, whether or not they were represented using JSON escape sequences in the input. The characters that are considered “special” for this purpose are:
  • all codepoints in the range U+0000 (NULL) to U+001F (IS1) or U+007F (DELETE) to U+009F (APC) ;

  • all codepoints that do not represent characters that are valid in the version of XML supported by the processor, including codepoints representing unpaired surrogates;

  • the backslash character itself (U+005C (REVERSE SOLIDUS, BACKSLASH, \) ).

Such characters are represented using a two-character escape sequence where available (for example, \t), or a six-character escape sequence otherwise (for example \uDEAD). Characters other than these will not be escaped in the result, even if they were escaped in the input. In the result:
  • Any string element whose string value contains a backslash character must have the attribute value escaped="true".

  • Any element that contains a key attribute whose string value contains a backslash character must have the attribute escaped-key="true".

  • The values of the escaped and escaped-key attributes are immaterial when there is no backslash present, and it is never necessary to include either attribute when its value is false.

fallback?

Provides a function which is called when the input contains an escape sequence that represents a character that is not valid in the version of XML supported by the implementation. It is an error to supply the fallback option if the escape option is present with the value true.
  • Type: (fn(xs:string) as xs:anyAtomicType)?

  • Default: fn { char(0xFFFD) }

User-supplied function The function is called when the JSON input contains an escape sequence that is valid according to the JSON grammar, but which does not represent a character that is valid in the version of XML supported by the processor. In the case of surrogates, it is called once for any six-character escape sequence that is not properly paired with another surrogate. The untyped atomic item supplied as the argument will always be a two- or six-character escape sequence, starting with a backslash, that conforms to the rules in the JSON grammar (as extended by the implementation if liberal:true() is specified): for example \b or \uFFFF or \uDEAD.

By default, the escape sequence is replaced with the Unicode REPLACEMENT CHARACTER. The function is not called for an escape sequence that is invalid against the grammar (for example \x0A). The string, which results from invoking fn:string on the result of the function, is inserted into the result in place of the invalid character. The function also has the option of raising a dynamic error by calling fn:error.

number-parser?

Determines how numeric values should be processed.
  • Type: (fn(xs:untypedAtomic) as item()?)?

  • Default: xs:identity#1

User-supplied function The supplied function is called to process the string value of any JSON number in the input. The string value of the number element generated in the result will be the value obtained by calling the supplied function, and then converting its result to a string by calling fn:string#1.

By default, numbers are represented in the XML output exactly as they were written in the input. Supplying the value xs:double#1 will cause the value to be convered to type xs:double (which will then be represented in the XML by converting the xs:double to a string). Similarly xs:decimal#1 will convert to xs:decimal (which potentially retains more precision, but disallows exponential notation), while supplying a function that casts to (xs:decimal | xs:double) will treat the value as xs:decimal if there is no exponent, or as xs:double otherwise. The default value fn:identity#1 causes the value to be retained unchanged as an xs:untypedAtomic. Before calling the supplied number-parser, the value is first checked to ensure that it conforms to the JSON grammar (for example, a leading plus sign and redundant leading zeroes are not allowed); these checks are disabled if the liberal option is set to true. Note that the option validate=true will cause the result to be validated as type xs:double (disallowing NaN and infinity).

The various structures that can occur in JSON are transformed recursively to XDM values according to the rules given in 17.4.2 XML Representation of JSON.

The function returns a document node, whose only child is the element node representing the outermost construct in the JSON text.

The function is nondeterministic with respect to node identity: that is, if the function is called twice with the same arguments, it is implementation-dependent whether the same node is returned on both occasions.

The base URI of the returned document node is taken from the executable base URIXP of the function call.

The choice of namespace prefix (or absence of a prefix) in the names of constructed nodes is implementation-dependent.

The XDM tree returned by the function does not contain any unnecessary (albeit valid) nodes such as whitespace text nodes, comments, or processing instructions. It does not include any whitespace in the value of number or boolean element nodes, nor in the value of escaped or escaped-key attribute nodes.

If the result is typed, every element named string will have an attribute named escaped whose value is either true or false, and every element having an attribute named key will also have an attribute named escaped-key whose value is either true or false.

If the result is untyped, the attributes escaped and escaped-key will either be present with the value true, or will be absent. They will never be present with the value false.

Error Conditions

An error is raised [err:FOJS0001] if the value of $value does not conform to the JSON grammar as defined by [RFC 7159], unless the option "liberal":true() is present and the processor chooses to accept the deviation.

An error is raised [err:FOJS0004] if the value of the validate option is true and the processor does not support schema validation or typed data.

An error is raised [err:FOJS0005] if the value of $options includes an entry whose key is defined in this specification, and whose value is not a permitted value for that key.

Notes

To read a JSON file, this function can be used in conjunction with the fn:unparsed-text function.

Many JSON implementations allow commas to be used after the last item in an object or array, although the specification does not permit it. The option spec="liberal" is provided to allow such deviations from the specification to be accepted. Some JSON implementations also allow constructors such as new Date("2000-12-13") to appear as values: specifying spec="liberal" allows such extensions to be accepted, but does not guarantee it. If such extensions are accepted, the resulting value is implementation-defined, and will not necessarily conform to the schema at D.2 Schema for the result of fn:json-to-xml.

If the input starts with a byte order mark, this function ignores it. The byte order mark may have been added to the data stream in order to facilitate decoding of an octet stream to a character string, but since this function takes a character string as input, the byte order mark serves no useful purpose.

The possibility of the input containing characters that are not valid in XML (for example, unpaired surrogates) arises only when such characters are expressed using JSON escape sequences. This is the only possibility because the input to the function is an instance of xs:string, which by definition can contain only those characters that are valid in XML.

Examples
Expression:
json-to-xml(
  '{ "x": 1, "y": [ 3, 4, 5 ] }',
  { "validate": false() }
)
Result:
<map xmlns="http://www.w3.org/2005/xpath-functions">
  <number key="x">1</number>
  <array key="y">
   <number>3</number>
   <number>4</number>
   <number>5</number>
  </array>
</map>

(with whitespace added for legibility)

Expression:
json-to-xml(
  '"abcd"',
  { 'liberal': false() }
)
Result:
<string xmlns="http://www.w3.org/2005/xpath-functions">abcd</string>
Expression:
json-to-xml(
  '{ "x": "\\", "y": "\u0025" }',
  { "validate": false() }
)
Result:
<map xmlns="http://www.w3.org/2005/xpath-functions">
  <string key="x">\</string>
  <string key="y">%</string>
</map>

(with whitespace added for legibility)

Expression:
json-to-xml(
  '{ "x": "\\", "y": "\u0025" }',
  { 'escape': true(), "validate": false() }
)
Result:
<map xmlns="http://www.w3.org/2005/xpath-functions">
  <string escaped="true" key="x">\\</string>
  <string key="y">%</string>
</map>

(with whitespace added for legibility)

(But see the detailed rules for alternative values of the escaped attribute on the second string element.)

The following example illustrates use of the fallback function to handle characters that are invalid in XML.

let $json := unparsed-text('http://example.com/endpoint')
let $options := {
  'liberal': true(),
  'fallback': fn($char as xs:string) as xs:string {
    let $c0chars := {
      '\u0000': '[NUL]',
      '\u0001': '[SOH]',
      '\u0002': '[STX]',
      ...
      '\u001E': '[RS]',
      '\u001F': '[US]'
    }
    let $replacement := $c0chars($char)
    return if (exists($replacement)) then (
      $replacement
    ) else (
      error( #err:invalid-char,
        'Error: ' || $char || ' is not a C0 control character.'
      )
    )
  }
}
return json-to-xml($json, $options)

17.4.7 fn:xml-to-json

Changes in 4.0 (next | previous)

  1. An option has been added to suppress the escaping of the solidus (forwards slash) character.  [Issue 1347 PR 1353]

  2. Numbers now retain their original lexical form, except for any changes needed to satisfy JSON syntax rules (for example, stripping leading zero digits).  [Issue 1445 PR 1455]

Summary

Converts an XML tree, whose format corresponds to the XML representation of JSON defined in this specification, into a string conforming to the JSON grammar.

Signature
fn:xml-to-json(
$nodeas node()?,
$optionsas map(*)?:= {}
) as xs:string?
Properties

This function is deterministic, context-independent, and focus-independent.

Rules

If the second argument is omitted or an empty sequence, the result is the same as calling the two-argument form with an empty map as the value of the $options argument.

The first argument $node is a node; the subtree rooted at this node will typically be the XML representation of a JSON document as defined in 17.4.2 XML Representation of JSON.

If $node is the empty sequence, the function returns the empty sequence.

The $options argument can be used to control the way in which the conversion takes place. The option parameter conventions apply.

The entries that may appear in the $options map are as follows:

record(
escape-solidus?as xs:boolean,
indent?as xs:boolean
)
KeyValueMeaning

escape-solidus?

Determines whether the character U+002F (SOLIDUS, FORWARD SLASH, /) should be escaped as \/. By default the character is escaped, but this is only necessary when the resulting JSON is embedded in HTML.
  • Type: xs:boolean

  • Default: true

false The character U+002F (SOLIDUS, FORWARD SLASH, /) is output as is, without escaping.
true The character U+002F (SOLIDUS, FORWARD SLASH, /) is escaped by preceding it with U+005C (REVERSE SOLIDUS, BACKSLASH, \) .

indent?

Determines whether additional whitespace should be added to the output to improve readability.
  • Type: xs:boolean

  • Default: false

false The processor must not insert any insignificant whitespace between JSON tokens.
true The processor may insert whitespace between JSON tokens in order to improve readability. The specification imposes no constraints on how this is done.

The node supplied as $node must be one of the following: [err:FOJS0006]

  1. An element node whose name matches the name of a global element declaration in the schema given in D.2 Schema for the result of fn:json-to-xml (“the schema”) and that is valid as defined below:

    1. If the type annotation of the element matches the type of the relevant element declaration in the schema (indicating that the element has been validated against the schema), then the element is considered valid.

    2. Otherwise, the processor may attempt to validate the element against the schema, in which case it is treated as valid if and only if the outcome of validation is valid.

    3. Otherwise (if the processor does not attempt validation using the schema), the processor must ensure that the content of the element, after stripping all attributes (at any depth) in namespaces other than http://www.w3.org/2005/xpath-functions, is such that validation against the schema would have an outcome of valid.

      Note:

      The process described here is not precisely equivalent to schema validation. For example, schema validation will fail if there is an invalid xsi:type or xsi:nil attribute, whereas this process will ignore such attributes.

  2. An element node E having a key attribute and/or an escaped-key attribute provided that E would satisfy one of the above conditions if the key and/or escaped-key attributes were removed.

  3. A document node having exactly one element child and no text node children, where the element child satisfies one of the conditions above.

Furthermore, $node must satisfy the following constraint (which cannot be conveniently expressed in the schema). Every element M that is a descendant-or-self of $node and has local name map and namespace URI http://www.w3.org/2005/xpath-functions must satisfy the following rule: there must not be two distinct children of M (say C1 and C2) such that the normalized key of C1 is equal to the normalized key of C2. The normalized key of an element C is as follows:

  • If C has the attribute value escaped-key="true", then the value of the key attribute of C, with all JSON escape sequences replaced by the corresponding Unicode characters according to the JSON escaping rules.

  • Otherwise (the escaped-key attribute of C is absent or set to false), the value of the key attribute of C.

Nodes in the input tree are handled by applying the following rules, recursively. In these rules the phrase “an element named N” means “an element node whose local name is N and whose namespace URI is http://www.w3.org/2005/xpath-functions”.

  1. A document node having a single element node child is processed by processing that child.

  2. An element named null results in the output null.

  3. An element $E named boolean results in the output true or false depending on the result of xs:boolean(fn:string($E)).

  4. An element $E named number is processed as follows.

    The input is required to conform to the XSD rules defining a valid instance of xs:double (excluding infinity and NaN), while the output is required to conform to the JSON rules defining a valid JSON number. These rules are slightly different.

    Specifically, the XSD rules require the value (after removing leading and trailing whitespace) to match the regular expression:

    (\+|-)?([0-9]+(\.[0-9]*)?|\.[0-9]+)([Ee](\+|-)?[0-9]+)?

    while the JSON rules require:

    -?(0|[1-9][0-9]*)(\.[0-9]+)?([Ee](\+|-)?[0-9]+)?

    If the input value does not match the required JSON format, it must therefore be adjusted by applying the following steps:

    • Remove leading and trailing whitespace.

    • Remove any leading plus sign.

    • Remove any leading zero digits in the integer part, while ensuring that at least one digit remains.

    • If there is a decimal point that is not preceded by a digit, add a zero digit before the decimal point.

    • If there is a decimal point that is not followed by a digit, add a zero digit after the decimal point.

    Note:

    The output uses exponential notation if and only if the input uses exponential notation.

    The rules have changed since version 3.1 of this specification. In previous versions, the supplied number was cast to an xs:double, and then serialized using the rules of the fn:string function. This resulted in JSON numbers using exponential notation for values outside the range 1e-6 to 1e6, and led to a loss of precision for 64-bit integer values.

  5. An element named string results in the output of the string value of the element, enclosed in quotation marks, with any special characters in the string escaped as described below.

  6. An element named array results in the output of the children of the array element, each processed by applying these rules recursively: the items in the resulting list are enclosed between square brackets, and separated by commas.

  7. An element named map results in the output of a sequence of map entries corresponding to the children of the map element, enclosed between curly braces and separated by commas. Each entry comprises the value of the key attribute of the child element, enclosed in quotation marks and escaped as described below, followed by a colon, followed by the result of processing the child element by applying these rules recursively. The order of properties in the output JSON representation retains the order of the children of the map element.

  8. Comments, processing instructions, and whitespace text node children of map and array are ignored.

Strings are escaped as follows:

  1. If the attribute escaped="true" is present for a string value, or escaped-key="true" for a key value, then:

    1. any valid JSON escape sequence present in the string is copied unchanged to the output;

    2. any invalid JSON escape sequence results in a dynamic error [err:FOJS0007];

    3. any unescaped occurrence of U+0022 (QUOTATION MARK, ") , U+0008 (BACKSPACE) , U+000C (FORM FEED) , U+000A (NEWLINE) , U+000D (CARRIAGE RETURN) , U+0009 (TAB) , or (subject to the escape-solidus option) U+002F (SOLIDUS, FORWARD SLASH, /) is replaced by \", \b, \f, \n, \r, \t, or \/ respectively;

    4. any other codepoint in the range 1-31 or 127-159 is replaced by an escape in the form \uHHHH where HHHH is the upper-case hexadecimal representation of the codepoint value.

  2. Otherwise (that is, in the absence of the attribute escaped="true" for a string value, or escaped-key="true" for a key value):

    1. any occurrence of backslash is replaced by \\

    2. any occurrence of U+0022 (QUOTATION MARK, ") , U+0008 (BACKSPACE) , U+000C (FORM FEED) , U+000A (NEWLINE) , U+000D (CARRIAGE RETURN) , or U+0009 (TAB) is replaced by \", \b, \f, \n, \r, or \t respectively;

    3. any other codepoint in the range 1-31 or 127-159 is replaced by an escape in the form \uHHHH where HHHH is the upper-case hexadecimal representation of the codepoint value.

Error Conditions

A dynamic error is raised [err:FOJS0005] if the value of $options includes an entry whose key is defined in this specification, and whose value is not a permitted value for that key.

A dynamic error is raised [err:FOJS0006] if the value of $node is not a document or element node or is not valid according to the schema for the XML representation of JSON, or if a map element has two children whose normalized key values are the same.

A dynamic error is raised [err:FOJS0007] if the value of $node includes a string labeled with escaped="true", or a key labeled with escaped-key="true", where the content of the string or key contains an invalid JSON escape sequence: specifically, where it contains a backslash (\) that is not followed by one of the characters ", \, /, b, f, n, r, t, or u, or where it contains the characters \u not followed by four hexadecimal digits (that is [0-9A-Fa-f]{4}).

Notes

The rule requiring schema validity has a number of consequences, including the following:

  1. The input cannot contain no-namespace attributes, or attributes in the namespace http://www.w3.org/2005/xpath-functions, except where explicitly allowed by the schema. Attributes in other namespaces, however, are ignored.

  2. Nodes that do not affect schema validity, such as comments, processing instructions, namespace nodes, and whitespace text node children of map and array, are ignored.

  3. Numeric values are restricted to those that are valid in JSON: the schema disallows positive and negative infinity and NaN.

  4. Duplicate key values are not permitted. Most cases of duplicate keys are prevented by the rules in the schema; additional cases (where the keys are equal only after expanding JSON escape sequences) are prevented by the prose rules of this function. For example, the key values \n and \u000A are treated as duplicates even though the rules in the schema do not treat them as such.

The rule allowing the top-level element to have a key attribute (which is ignored) allows any element in the output of the fn:json-to-xml function to be processed: for example, it is possible to take a JSON document, convert it to XML, select a subtree based on the value of a key attribute, and then convert this subtree back to JSON, perhaps after a transformation. The rule means that an element with the appropriate name will be accepted if it has been validated against one of the types mapWithinMapType, arrayWithinMapType, stringWithinMapType, numberWithinMapType, booleanWithinMapType, or nullWithinMapType.

Examples

The input <array xmlns="http://www.w3.org/2005/xpath-functions"><number>1</number><string>is</string><boolean>1</boolean></array> produces the result [ 1, "is", true ].

The input <map xmlns="http://www.w3.org/2005/xpath-functions"><number key="Sunday">1</number><number key="Monday">2</number></map> produces the result { "Sunday": 1, "Monday": 2 }.

The input <array xmlns="http://www.w3.org/2005/xpath-functions"><number>10</number><number>17e2</number><number>0005</number></array> produces the result [ 10, 17e2, 5 ].

17.5 Functions on CSV Data

Changes in 4.0 (next | previous)

  1. New functions are available for processing input data in CSV (comma separated values) format.   [Issue 413 PRs 533 719 834]

This section describes functions that parse CSV data.

[Definition] The term comma separated values or CSV refers to a wide variety of plain-text tabular data formats with fields and records separated by standard character delimiters (often, but not invariably, commas).

A CSV is a 2-dimensional tabular data structure consisting of multiple rows (also known as records). Each row contains multiple fields. Fields occupying the same position in successive rows constitute a column. Columns are identified by position and optionally by name. Column names can be assigned within a CSV using an optional header row.

CSV has developed informally for decades, and many variations are found. This specification refers to [RFC 4180], which provides a standardized grammar. This specification extends the grammar defined in [RFC 4180] as follows:

  • This specification uses the term row where RFC 4180 uses record.

  • Line endings are normalized: specifically, the character sequences U+000D (CARRIAGE RETURN) , or U+000D (CARRIAGE RETURN) followed by U+000A (NEWLINE) , are converted to a single U+000A (NEWLINE) character. This applies whether or not the line ending appears within a quoted string, and whether or not U+000A (NEWLINE) is the chosen row delimiter.

  • Row delimiters other than newline are recognized.

  • Field delimiters other than U+002C (COMMA, ,) are recognized.

  • Quote characters other than U+0022 (QUOTATION MARK, ") are recognized.

  • Non-ASCII characters are recognized.

This specification defines a mapping from this extended grammar to constructs in the XDM model, and provides illustrative examples of how these constructs can be combined with other language features to process CSV data.

FunctionMeaning
fn:csv-to-arraysParses CSV data supplied as a string, returning the results in the form of a sequence of arrays of strings.
fn:parse-csvParses CSV data, returning the results in the form of a record containing information about the names in the header, as well as the data itself.
fn:csv-docReads an external resource containing CSV, and returns the results as a record containing information about the names in the header, as well as the data itself.
fn:csv-to-xmlParses CSV data supplied as a string, returning the results as an XML document, as described by 17.5.9 Representing CSV data as XML.

The most basic function for parsing CSV is fn:csv-to-arrays which recognizes the delimiters for rows and fields and returns a sequence of arrays each corresponding to one row. The fields within each array are represented as instances of xs:string.

The other two functions recognize column names, and make it easier to address individual fields using these names. The parse-csv function delivers this capability using XDM maps and functions, while csv-to-xml function represents the information using XDM element nodes.

17.5.4 fn:csv-to-arrays

Changes in 4.0 (next | previous)

  1. New in 4.0  [Issues 413 1052 PRs 533 719 834 1066]

Summary

Parses CSV data supplied as a string, returning the results in the form of a sequence of arrays of strings.

Signature
fn:csv-to-arrays(
$valueas xs:string?,
$optionsas map(*)?:= {}
) as array(xs:string)*
Properties

This function is deterministic, context-independent, and focus-independent.

Rules

The $value argument is CSV data, as defined in [RFC 4180], in the form of an xs:string value. The function parses this string, after normalizing newlines so that U+000D (CARRIAGE RETURN) and (U+000D (CARRIAGE RETURN) , U+000A (NEWLINE) ) sequences are converted to U+000A (NEWLINE) . The result of the function is a sequence of arrays of strings, that is array(xs:string)*; each array represents one row of the CSV input.

If $value is the empty sequence or a zero-length string, the function returns an empty sequence.

The $options argument can be used to control the way in which the parsing takes place. The option parameter conventions apply.

If the $options argument is omitted or an empty sequence, the result is the same as calling the two-argument form with an empty map as the value of the $options argument.

The entries that may appear in the $options map are as follows:

record(
field-delimiter?as xs:string,
row-delimiter?as xs:string,
quote-character?as xs:string,
trim-whitespace?as xs:boolean
)
KeyValueMeaning

field-delimiter?

The character used to delimit fields within a record. An instance of xs:string whose length is exactly one.
  • Type: xs:string

  • Default: ","

row-delimiter?

The character used to delimit rows within the CSV string. An instance of xs:string whose length is exactly one. Defaults to a single newline character (U+000A (NEWLINE) ).
  • Type: xs:string

  • Default: char('\n')

quote-character?

The character used to quote fields within the CSV string. An instance of xs:string whose length is exactly one.
  • Type: xs:string

  • Default: '"'

trim-whitespace?

Determines whether leading and trailing whitespace is removed from the content of unquoted fields.
  • Type: xs:boolean

  • Default: false

falseUnquoted fields will be returned with any leading or trailing whitespace intact.
trueUnquoted fields will be returned with leading or trailing whitespace removed, and all other whitespace preserved.

An empty field is represented by a zero-length string. An empty field is deemed to exist when a field delimiter immediately follows either another field delimiter, or a row delimiter, or the start of $value; or when a row delimiter or the end of $value immediately follows a field delimiter.

A blank row is represented as an empty array (not as an array containing a single empty field). A blank row is deemed to exist when a row delimiter immediately follows either another row delimiter or the start of $value, after trimming of whitespace if the trim-whitespace option is true. No blank row occurs after the final row delimiter.

If $value is a zero-length string, the CSV is considered to contain no rows; while if $value consists of a single row delimiter, it is considered to contain a single blank row. The presence or absence of a final row delimiter generally has no effect on the result, except when it appears at the start of the input, in which case it causes a single blank row to exist.

Error Conditions

A dynamic error [err:FOCV0001] occurs if the value of $csv does not conform to the required grammar.

A dynamic error [err:FOCV0002] occurs if the value of the field-delimiter, row-delimiter, or quote-character option is not a single character.

A dynamic error [err:FOCV0003] occurs if the same character is used for more than one of the field-delimiter, row-delimiter, and quote-character.

Notes

The default row delimiter is a single newline character U+000A (NEWLINE) . Alternative line endings such as CR and CRLF will already have been normalized to a single newline.

All fields are returned as xs:string values.

Quoted fields in the input are returned without the quotes.

The first row is not treated specially.

For more discussion of the returned data, see 17.5.3 Basic parsing of CSV to arrays.

Examples

Handling trivial input:

Expression:
csv-to-arrays(())
Result:
()
Expression:
csv-to-arrays("")
Result:
()
Expression:
csv-to-arrays(char('\n'))
Result:
[]
Expression:
csv-to-arrays(" ", { 'trim-whitespace': true() })
Result:
()
Expression:
csv-to-arrays(" ", { 'trim-whitespace': false() })
Result:
[ " " ]
Expression:
csv-to-arrays(` { char('\n') }`, { 'trim-whitespace': true() })
Result:
[]
Expression:
csv-to-arrays(` { char('\n') }`, { 'trim-whitespace': false() })
Result:
[ " " ]
Expression:
csv-to-arrays(`{ char('\n') } `, { 'trim-whitespace': true() })
Result:
[]
Expression:
csv-to-arrays(`{ char('\n') } `, { 'trim-whitespace': false() })
Result:
[], [ " " ]

Using newline separators:

Expression:
csv-to-arrays(
  `name,city{ char('\n') }` ||
  `Bob,Berlin{ char('\n') }` ||
  `Alice,Aachen{ char('\n') }`
)
Result:
[ "name", "city" ],
[ "Bob", "Berlin" ],
[ "Alice", "Aachen" ]
Expression:
let $CRLF := `{ char('\r') }{ char('\n') }`
return csv-to-arrays(
  `name,city{ $CRLF }` ||
  `Bob,Berlin{ $CRLF }` ||
  `Alice,Aachen{ $CRLF }`
)
Result:
[ "name", "city" ],
[ "Bob", "Berlin" ],
[ "Alice", "Aachen" ]

Quote handling:

Expression:
csv-to-arrays(
  string-join(
    (`"name","city"`, `"Bob","Berlin"`, `"Alice","Aachen"`),
    char('\n')
  )
)
Result:
[ "name", "city" ],
[ "Bob", "Berlin" ],
[ "Alice", "Aachen" ]
Expression:
csv-to-arrays(
  `"name","city"{ char('\n') }` ||
  `"Bob ""The Exemplar"" Mustermann","Berlin"{ char('\n') }`
)
Result:
(
  [ "name", "city" ],
  [ 'Bob "The Exemplar" Mustermann', "Berlin" ]
)

Non-default record- and field-delimiters:

Expression:
csv-to-arrays(
  "name;city§Bob;Berlin§Alice;Aachen", 
  { "row-delimiter": "§", "field-delimiter": ";" }
)
Result:
[ "name", "city" ],
[ "Bob", "Berlin" ],
[ "Alice", "Aachen" ]

Non-default quote character:

Expression:
csv-to-arrays(
  string-join(
    ("|name|,|city|", "|Bob|,|Berlin|"),
    char('\n')
  ), 
  { "quote-character": "|" }
)
Result:
[ "name", "city" ],
[ "Bob", "Berlin" ]

Trimming whitespace in fields:

Expression:
csv-to-arrays(
  string-join(
    ("name  ,city    ", "Bob   ,Berlin  ", "Alice ,Aachen  "),
    char('\n')
  ),
  { "trim-whitespace": true() }
)
Result:
[ "name", "city" ],
[ "Bob", "Berlin" ],
[ "Alice", "Aachen" ]

17.5.7 fn:parse-csv

Changes in 4.0 (next | previous)

  1. New in 4.0  [Issues 413 1052 PRs 533 719 834 1066 19 March 2024]

Summary

Parses CSV data, returning the results in the form of a record containing information about the names in the header, as well as the data itself.

Signature
fn:parse-csv(
$valueas xs:string?,
$optionsas map(*)?:= {}
) as parsed-csv-structure-record?
Properties

This function is deterministic, context-independent, and focus-independent.

Rules

If $value is the empty sequence, the function returns the empty sequence.

The input supplied in $value is CSV data, as defined in [RFC 4180]. The function first parses the input using fn:csv-to-arrays, and then further processes the result. The initial parsing is exactly as defined for fn:csv-to-arrays, and can be controlled using the same options. Additional options are available to control the way in which header information and column names are handled.

If the input is the a zero-length string, the function returns a parsed-csv-structure-record whose rows entry is the empty sequence.

The $options argument can be used to control the way in which the parsing takes place. The option parameter conventions apply.

If the $options argument is omitted or is an empty sequence, the result is the same as calling the two-argument form with an empty map as the value of the $options argument.

The entries that may appear in the $options map are as follows:

record(
field-delimiter?as xs:string,
row-delimiter?as xs:string,
quote-character?as xs:string,
trim-whitespace?as xs:boolean,
header?as item()*,
select-columns?as xs:positiveInteger*,
trim-rows?as xs:boolean
)
KeyValueMeaning

field-delimiter?

The character used to delimit fields within a record. An instance of xs:string whose length is exactly one.
  • Type: xs:string

  • Default: ","

row-delimiter?

The character used to delimit rows within the CSV string. An instance of xs:string whose length is exactly one. Defaults to a single newline character (U+000A (NEWLINE) ). Note that this is tested after line endings are normalized.
  • Type: xs:string

  • Default: char('\n')

quote-character?

The character used to quote fields within the CSV string. An instance of xs:string whose length is exactly one.
  • Type: xs:string

  • Default: '"'

trim-whitespace?

Determines whether leading and trailing whitespace is removed from the content of unquoted fields.
  • Type: xs:boolean

  • Default: false

falseUnquoted fields will be returned with any leading or trailing whitespace intact.
trueUnquoted fields will be returned with leading or trailing whitespace removed, and all other whitespace preserved.

header?

Determines whether the first row of the CSV should be treated as a list of column names, or whether column names are being supplied by the caller. The value must either be a single boolean, or a sequence of zero or more strings.
  • Type: item()*

  • Default: false

trueColumn names are taken from the first row of the CSV data.
falseColumn names are not available; all references to columns are by ordinal position.
xs:string*Supplies explicit names for the columns. The Nth name in the list applies to the Nth column after any filtering or rearrangement. A zero-length string can be used when there is a column that requires no name.

select-columns?

A sequence of integers indicating which columns to include and in which order. If this option is absent or empty, all columns are returned in their original order. For example, the value 1 to 4 indicates that the output contains the first, second, third, and fourth columns from the input, in order, while (1, 5, 4) indicates that the output contains three columns, taken from the first, fifth, and fourth columns of the input, in that order. An integer in the sequence is treated as the 1-based index of the column to include. Any other columns are dropped. If a particular row includes no field at the specified index, an empty field is included at the relevant position in the result. If an integer appears more than once then the result will include duplicated columns.
  • Type: xs:positiveInteger*

  • Default: ()

trim-rows?

Determines whether all rows should be adjusted to contain the same number of fields. This option is ignored if select-columns is specified.
  • Type: xs:boolean

  • Default: false

falseNo padding or trimming of rows takes place, unless requested using the select-columns option.
trueThe number of fields in the first row (whether this be a header or a data row) determines the number of fields in every subsequent row; to achieve this, excess fields are removed, or additional zero-length fields are added.

The result of the function is a parsed-csv-structure-record, as defined in 17.5.6 Record fn:parsed-csv-structure-record.

Error Conditions

A dynamic error [err:FOCV0001] occurs if the value of $csv does not conform to the required grammar.

A dynamic error [err:FOCV0002] occurs if any of the options field-delimiter, row-delimiter, or quote-character is not a single character.

A dynamic error [err:FOCV0003] occurs if the same character is used for more than one of the options field-delimiter, row-delimiter, and quote-character.

Notes

The default row delimiter is a single newline character U+000A (NEWLINE) . Alternative line endings such as CR and CRLF will already have been normalized to a single newline.

All fields are returned as xs:string values.

Quoted fields in the input are returned without the quotes.

For more discussion of the returned data, see 17.5.5 Enhanced parsing of CSV data to maps and arrays.

If the source of the CSV input is a resource accessible by URI, then it may be preferable to use the fn:csv-doc function. If the source is a binary value (xs:hexBinary or xs:base64Binary) then this can first be decoded as a string using the functions bin:infer-encoding and bin:decode-string.

Examples
Variables
let $display := fn($result) {
  (: tidy up the result for display (function items cannot be properly displayed) :)         
  map:put($result, "get", "(: function :)")
}

Default delimiters, no column headers:

Expression:
let $input := string-join(
  ("name,city", "Bob,Berlin", "Alice,Aachen"),
  char('\n')
)
let $result := parse-csv($input)
return (
  $result => $display(),
  $result?get(1, 2),
  $result?get(2, 2)
)
Result:
{
  "columns": (),
  "column-index": {},
  "rows": ([ "name", "city" ], [ "Bob", "Berlin" ], [ "Alice", "Aachen" ]),
  "get": "(: function :)"
},
"city",
"Berlin"

Default delimiters, column headers:

Expression:
let $input := string-join(
  ("name,city", "Bob,Berlin", "Alice,Aachen"),
  char('\n')
)
let $result := parse-csv($input, { "header": true() })
return (
  $result => $display(),
  $result?get(1, "name"),
  $result?get(2, "city")
)
Result:
{
  "columns": ("name", "city"),
  "column-index": { "name": 1, "city": 2 },
  "rows": ([ "Bob", "Berlin" ], [ "Alice", "Aachen" ]),
  "get": "(: function :)"
},
"Bob",
"Aachen"

Custom delimiters, no column headers:

Expression:
let $options := {
  "row-delimiter": "§", 
  "field-delimiter": ";", 
  "quote-character": "|"
}
let $input := "|name|;|city|§|Bob|;|Berlin|§|Alice|;|Aachen|"
let $result := parse-csv($input, $options)
return (
  $result => $display(),
  $result?get(3, 1)
)
Result:
{
  "columns": (),
  "column-index": {},
  "rows": ([ "name", "city" ], [ "Bob", "Berlin" ], [ "Alice", "Aachen" ]),
  "get": "(: function :)"
},
"Alice"

Supplied column names:

Expression:
let $headers := ("Person", "Location")
let $options := { "header": $headers, "row-delimiter": ";" }
let $input := "Alice,Aachen;Bob,Berlin;"
let $parsed-csv := parse-csv($input, $options)
return (
  $parsed-csv => $display(), 
  $parsed-csv?get(2, "Location")
)
Result:
{
  "columns": ("Person", "Location"),
  "column-index": { "Person": 1, "Location": 2 },
  "rows": ([ "Alice", "Aachen" ], [ "Bob", "Berlin" ]),
  "get": "(: function :)"                  
},
"Berlin"

Filtering columns, with ragged input and header: true()

Expression:
let $input := string-join((
   "date,name,city,amount,currency,original amount,note",
   "2023-07-19,Bob,Berlin,10.00,USD,13.99",
   "2023-07-20,Alice,Aachen,15.00",
   "2023-07-20,Charlie,Celle,15.00,GBP,11.99,cake,not a lie"
), char('\n'))
let $options := { 
  "header": true(), 
  "select-columns": (2, 1, 4)
}
let $result := parse-csv($input, $options)
return (
  $result => $display(),
  $result?get(2, "amount")
)
Result:
{
  "columns": ("name", "date", "amount"),
  "column-index": { "name": 1, "date": 2, "amount": 3 },
  "rows": (
    [ "Bob", "2023-07-19", "10.00" ],
    [ "Alice", "2023-07-20", "15.00" ],
    [ "Charlie", "2023-07-20", "15.00" ]
  ),
  "get": "(: function :)"                  
},
"15.00"

Filtering columns, with supplied column map

Expression:
let $input := string-join((
  "2023-07-20,Alice,Aachen,15.00",                  
  "2023-07-19,Bob,Berlin,10.00,USD,13.99",
  "2023-07-20,Charlie,Celle,15.00,GBP,11.99,cake,not a lie"
), char('\n'))
let $options := { 
  "header": ( "Person", "", "Amount" ),
  "select-columns": (2, 1, 4)
}
let $result := parse-csv($input, $options)
return (
  $result => $display(),
  $result?get(2, "Person"),
  $result?get(2, "Amount")
)
Result:
{
  "columns": ("Person", "", "Amount"),
  "column-index": { "Person": 1, "Amount": 3 },
  "rows": ([ "Alice", "2023-07-20", "15.00" ], 
           [ "Bob", "2023-07-19", "10.00" ], 
           [ "Charlie", "2023-07-20", "15.00" ]),
  "get": "(: function :)"                  
},
"Bob",
"10.00"

Specifying the number of columns explicitly, with header: false()

Expression:
let $input := string-join((
  "date,      name,     amount,    currency,   original amount",               
  "2023-07-19,Bob,      10.00,     USD,        13.99",
  "2023-07-20,Alice,    15.00",
  "2023-07-20,Charlie,  15.00,     GBP,        11.99,             extra data"
), char('\n'))
let $options := {
  "header": false(), 
  "select-columns": 1 to 5, 
  "trim-whitespace" :true()
}
let $result := parse-csv($input, $options)
return (
  $result => $display(),
  $result?get(4, 3)
)
Result:
{
  "columns": (),
  "column-index": {},
  "rows": (
    [ "date", "name", "amount", "currency", "original amount" ],
    [ "2023-07-19", "Bob", "10.00", "USD", "13.99" ],
    [ "2023-07-20", "Alice", "15.00", "", "" ],
    [ "2023-07-20", "Charlie", "15.00", "GBP", "11.99" ]
  ),
  "get": "(: function :)"                  
},
"15.00"

Specifying the number of columns with a number and header: true()

Expression:
let $input := string-join((
  "date,name,city,amount,currency,original amount,note",               
  "2023-07-19,Bob,Berlin,10.00,USD,13.99",
  "2023-07-20,Alice,Aachen,15.00",
  "2023-07-20,Charlie,Celle,15.00,GBP,11.99,cake,not a lie"
), char('\n'))
let $options := { "header": true(), "select-columns": 1 to 6 }
let $result := parse-csv($input, $options)
return (
  $result => $display(),
  $result?get(3, "original amount")
)
Result:
{
  "columns": ("date", "name", "city", 
              "amount", "currency", "original amount"),
  "column-index": {
    "date": 1, "name": 2, "city": 3, "amount": 4,
    "currency": 5, "original amount": 6
  },
  "rows": (
    [ "2023-07-19", "Bob", "Berlin", "10.00", "USD", "13.99"],
    [ "2023-07-20", "Alice", "Aachen", "15.00", "", ""],
    [ "2023-07-20", "Charlie", "Celle", "15.00", "GBP", "11.99"]
  ),
  "get": "(: function :)"                  
},
"11.99"

17.5.8 fn:csv-doc

Changes in 4.0 (next | previous)

  1. New in 4.0  [Issue 748 PR 2013 20 May 2025]

Summary

Reads an external resource containing CSV, and returns the results as a record containing information about the names in the header, as well as the data itself.

Signature
fn:csv-doc(
$sourceas xs:string?,
$optionsas map(*)?:= {}
) as fn:parsed-csv-structure-record?
Properties

This function is deterministic, context-dependent, and focus-independent. It depends on executable base URI.

Rules

If the second argument is omitted or an empty sequence, the result is the same as calling the two-argument form with an empty map as the value of the $options argument.

The effect of the two-argument function call fn:csv-doc($H, $M) is equivalent to the function composition fn:unparsed-binary($H) => fn:parse-csv($M).

If $source is the empty sequence, the function returns the empty sequence.

Note:

The ability to access external resources depends on whether the calling code is trustedXP.

Error Conditions

The function may raise any error defined for the fn:unparsed-text or fn:parse-csv functions.

17.5.10 fn:csv-to-xml

Changes in 4.0 (next | previous)

  1. New in 4.0  [Issues 413 1052 PRs 533 719 834 1066 1605]

Summary

Parses CSV data supplied as a string, returning the results as an XML document, as described by 17.5.9 Representing CSV data as XML.

Signature
fn:csv-to-xml(
$valueas xs:string?,
$optionsas map(*)?:= {}
) as document-node(fn:csv)?
Properties

This function is deterministic, context-dependent, and focus-independent. It depends on executable base URI.

Rules

The arguments have the same meaning, and are subject to the same constraints, as the arguments of fn:parse-csv.

If $value is the empty sequence, the function returns the empty sequence.

In other cases, the effect of the function is equivalent to the result of the following XQuery expression (where $options is an empty map if the argument is not supplied):

let $parsedCSV := parse-csv($value, $options)
let $colNames := $parsedCSV?columns
return document {
   <csv xmlns="http://www.w3.org/2005/xpath-functions"> {
     if (exists($colNames)) {
       <columns>{ $colNames ! <column>{ . }</column> }</columns>
     },
     <rows>{
       for $row in $parsedCSV?rows
       return <row>{
         for member $field at $col in $row
         return <field>{
           if ($colnames[$col]) {
             attribute column { $colnames[$col] }
           },
           $field
         }</field>
       }</row>
     }</rows> 
   }</csv> 
}

The elements in the returned XML are in the namespace http://www.w3.org/2005/xpath-functions; the namespace prefix that is used (or its absence) is implementation-dependent.

If the function is called twice with the same arguments, it is implementation-dependent whether the two calls return the same element node or distinct (but deep equal) element nodes. In this respect it is nondeterministic with respect to node identity.

The base URI of the element nodes in the result is implementation-dependent.

A schema is defined for the structure of the returned document: see D.3 Schema for the result of fn:csv-to-xml.

The result of the function will always be such that validation against this schema would succeed. However, it is implementation-defined whether the result is typed or untyped, that is, whether the elements and attributes in the returned tree have type annotations that reflect the result of validating against this schema.

Error Conditions

See fn:parse-csv.

Examples
Variables
let $crlf := char('\r') || char('\n')
let $csv-string := `name,city{ $crlf }Bob,Berlin{ $crlf }Alice,Aachen{ $crlf }`
let $csv-uneven-cols := concat(
  `date,name,city,amount,currency,original amount,note{ $crlf }`,
  `2023-07-19,Bob,Berlin,10.00,USD,13.99{ $crlf }`,
  `2023-07-20,Alice,Aachen,15.00{ $crlf }`,
  `2023-07-20,Charlie,Celle,15.00,GBP,11.99,cake,not a lie{ $crlf }`
)

An empty CSV with default column extraction (false):

Expression:
csv-to-xml(())
Result:
()
Expression:
csv-to-xml("")
Result:
<csv xmlns="http://www.w3.org/2005/xpath-functions">
  <rows/>
</csv>

(with whitespace added for legibility)

Expression:
csv-to-xml(char('\n'))
Result:
<csv xmlns="http://www.w3.org/2005/xpath-functions">
  <rows>
    <row/>
  </rows>
</csv>

(with whitespace added for legibility)

An empty CSV with header extraction:

Expression:
csv-to-xml("", { "header": true() })
Result:
<csv xmlns="http://www.w3.org/2005/xpath-functions">
  <rows/>
</csv>

(with whitespace added for legibility)

An empty CSV with explicit column names:

Expression:
csv-to-xml("", { "header": ("name", "", "city") })
Result:
<csv xmlns="http://www.w3.org/2005/xpath-functions">
  <columns>
    <column>name</column>
    <column/>
    <column>city</column>
  </columns>
  <rows/>
</csv>

(with whitespace added for legibility)

With defaults for delimiters and quotes, recognizing headers:

Expression:
csv-to-xml($csv-string, { "header": true() })
Result:
<csv xmlns="http://www.w3.org/2005/xpath-functions">
  <columns>
    <column>name</column>
    <column>city</column>
  </columns>
  <rows>
    <row>
      <field column="name">Bob</field>
      <field column="city">Berlin</field>
    </row>
    <row>
      <field column="name">Alice</field>
      <field column="city">Aachen</field>
    </row>
  </rows>
</csv>

(with whitespace added for legibility)

Filtering columns

Expression:
csv-to-xml(
  $csv-uneven-cols, 
  { "header": true(), "select-columns": (2, 1, 4) }
)
Result:
<csv xmlns="http://www.w3.org/2005/xpath-functions">
  <columns>
    <column>name</column>
    <column>date</column>
    <column>amount</column>
  </columns>
  <rows>
    <row>
      <field column="name">Bob</field>
      <field column="date">2023-07-19</field>
      <field column="amount">10.00</field>
    </row>
    <row>
      <field column="name">Alice</field>
      <field column="date">2023-07-20</field>
      <field column="amount">15.00</field>
    </row>
    <row>
      <field column="name">Charlie</field>
      <field column="date">2023-07-20</field>
      <field column="amount">15.00</field>
    </row>
  </rows>
</csv>

(with whitespace added for legibility)

Ragged rows

Expression:
csv-to-xml(
  $csv-uneven-cols, 
  { "header": true() }
)
Result:
<csv xmlns="http://www.w3.org/2005/xpath-functions">
  <columns>
    <column>date</column>
    <column>name</column>
    <column>city</column>
    <column>amount</column>
    <column>currency</column>
    <column>original amount</column>
    <column>note</column>
  </columns>
  <rows>
    <row>
      <field column="date">2023-07-19</field>
      <field column="name">Bob</field>
      <field column="city">Berlin</field>
      <field column="amount">10.00</field>
      <field column="currency">USD</field>
      <field column="original amount">13.99</field>
    </row>
    <row>
      <field column="date">2023-07-20</field>
      <field column="name">Alice</field>
      <field column="city">Aachen</field>
      <field column="amount">15.00</field>
    </row>
    <row>
      <field column="date">2023-07-20</field>
      <field column="name">Charlie</field>
      <field column="city">Celle</field>
      <field column="amount">15.00</field>
      <field column="currency">GBP</field>
      <field column="original amount">11.99</field>
      <field column="note">cake</field>
      <field>not a lie</field>
    </row>
  </rows>
</csv>

(with whitespace added for legibility)

Trimming rows to constant width

Expression:
csv-to-xml(
  $csv-uneven-cols, 
  { "header": true(), "trim-rows": true() }
)
Result:
<csv xmlns="http://www.w3.org/2005/xpath-functions">
  <columns>
    <column>date</column>
    <column>name</column>
    <column>city</column>
    <column>amount</column>
    <column>currency</column>
    <column>original amount</column>
    <column>note</column>
  </columns>
  <rows>
    <row>
      <field column="date">2023-07-19</field>
      <field column="name">Bob</field>
      <field column="city">Berlin</field>
      <field column="amount">10.00</field>
      <field column="currency">USD</field>
      <field column="original amount">13.99</field>
      <field column="note"/>
    </row>
    <row>
      <field column="date">2023-07-20</field>
      <field column="name">Alice</field>
      <field column="city">Aachen</field>
      <field column="amount">15.00</field>
      <field column="currency"/>
      <field column="original amount"/>
      <field column="note"/>
    </row>
    <row>
      <field column="date">2023-07-20</field>
      <field column="name">Charlie</field>
      <field column="city">Celle</field>
      <field column="amount">15.00</field>
      <field column="currency">GBP</field>
      <field column="original amount">11.99</field>
      <field column="note">cake</field>
    </row>
  </rows>
</csv>

(with whitespace added for legibility)

Specifying a fixed number of columns

Expression:
csv-to-xml(
  $csv-uneven-cols, 
  { "header": true(), "select-columns": 1 to 6 }
)
Result:
<csv xmlns="http://www.w3.org/2005/xpath-functions">
  <columns>
    <column>date</column>
    <column>name</column>
    <column>city</column>
    <column>amount</column>
    <column>currency</column>
    <column>original amount</column>
  </columns>
  <rows>
    <row>
      <field column="date">2023-07-19</field>
      <field column="name">Bob</field>
      <field column="city">Berlin</field>
      <field column="amount">10.00</field>
      <field column="currency">USD</field>
      <field column="original amount">13.99</field>
    </row>
    <row>
      <field column="date">2023-07-20</field>
      <field column="name">Alice</field>
      <field column="city">Aachen</field>
      <field column="amount">15.00</field>
      <field column="currency"/>
      <field column="original amount"/>
    </row>
    <row>
      <field column="date">2023-07-20</field>
      <field column="name">Charlie</field>
      <field column="city">Celle</field>
      <field column="amount">15.00</field>
      <field column="currency">GBP</field>
      <field column="original amount">11.99</field>
    </row>
  </rows>
</csv>

(with whitespace added for legibility)

17.6 Functions on Invisible XML

This section describes functions that support [Invisible XML] parsing.

Invisible XML defines a BNF-like language for specifying grammars, together with a mapping from sentences in that grammar to an XML representation. By defining an Invisible XML grammar, a great variety of non-XML data formats can be manipulated as if they were XML. The function fn:invisible-xml takes a grammar as input, and returns a function which can be used for parsing data instances and converting them to XML node trees.

17.6.1 fn:invisible-xml

Changes in 4.0 (next | previous)

  1. New in 4.0  [Issues 238 991 1281 1404 PRs 791 1256 1282 1405]

Summary

Creates an Invisible XML parser for a grammar.

Signature
fn:invisible-xml(
$grammaras (xs:string | element(ixml))?:= (),
$optionsas map(*)?:= {}
) as fn(xs:string) as item()
Properties

This function is deterministic, context-independent, and focus-independent.

Rules

Conceptually, an [Invisible XML] processor takes two arguments: a grammar and an input string. The grammar is a description of some format and the parser will attempt to interpret the input string according to that description. The parser returns an XML representation of the input string as parsed by the provided grammar. If parsing fails, it returns an XML representation that indicates an error occurred and may provide additional error information.

If the function is called twice with the same arguments, it is nondeterministic with respect to node identity.

For example, the following grammar describes a date as consisting of a year, a month, and a day. Each are a sequence of digits and they are separated by hyphens:

 date = year, -'-', month, -'-', day .
 year = d, d, d, d .
month = '0', d | '1', ['0'|'1'|'2'] .
  day = ['0'|'1'|'2'], d | '3', ['0'|'1'] .
   -d = ['0'-'9'] .

Using this grammar to parse “2023-10-31” will produce:

<date><year>2023</year><month>10</month><day>31</day></date>

Using this grammar to parse “2023-10-32” will produce something like this:

<fail xmlns:ixml='http://invisiblexml.org/NS' ixml:state='failed'>
  <line>1</line>
  <column>10</column>
  <pos>9</pos>
  <unexpected>3</unexpected>
  <permitted>'3', ['0'; '1'; '2']</permitted>
</fail>

The exact format of the error output will vary between implementations. The only required part of the output is the ixml:state attribute that contains the value failed.

Note:

Careful readers will observe that the example grammar will parse “2023-00-00” as a date. The grammar could easily be extended to exclude the “00” forms for month and day, but this is only intended to be an illustrative example.

The fn:invisible-xml function takes a grammar and returns a function that can be used to parse input strings. In practice, constructing a parser from a grammar may be an expensive operation. Returning a parsing function makes it easy to efficiently reuse a parser.

The provided grammar must be a string conforming to the Invisible XML specification grammar or an XML representation of such a grammar.

The following options are available. The option parameter conventions apply.

record(
fail-on-error?as xs:boolean
)
KeyMeaning

fail-on-error?

Raise an error if the parse function fails
  • Type: xs:boolean

  • Default: false

Additional, implementation-defined options may be available, for example, to control aspects of the XML serialization, to specify the grammar start symbol, or to produce output formats other than XML.

If $grammar is the empty sequence, a parser is returned for the Invisible XML specification grammar. This should be the same grammar that the implementation uses to parse iXML grammars. If $grammar is not empty, it must be a valid Invisible XML grammar. If it is not, fn:invisible-xml raises err:FOIX0001.

The parsing function that is returned behaves as follows:

  1. It takes a string as input and returns an item as its result, usually an XML document containing the result of the parse. (The return type is item() to allow implementations to provide other sorts of results.)

  2. It is nondeterministic with respect to node identity (that is, if it is called twice with the same input string, it may or may not return the same document node each time).

If the fail-on-error option is true, the parsing function will raise err:FOIX0002 if the input provided cannot be parsed successfully. Otherwise, it returns an XML representation of the error (rooted at a document node) as described by the [Invisible XML] specification.

Examples
Expression:
invisible-xml("S=A. A='a'.")("a")
Result:
<S><A>a</A></S>
Expression:
let $parser := invisible-xml("S=A. A='a'.")
let $result := $parser("b")
return $result/*/@*:state = 'failed'
Result:
true()

(The returned document contains information about the error in the parsed string.)

Expression:
let $parser := invisible-xml("S=A. A='a'.", { "fail-on-error": true() })
let $result := $parser("b")
return $result
Result:

Raises error FOIX0002.

18 Dynamic evaluation

The following functions allow dynamic loading and evaluation of XQuery queries, XSLT stylesheets, and XPath binary operators.

FunctionMeaning
fn:load-xquery-moduleProvides access to the public functions and global variables of a dynamically loaded XQuery library module.
fn:transformInvokes a transformation using a dynamically loaded XSLT stylesheet.
fn:opReturns a function whose effect is to apply a supplied binary operator to two arguments.

18.2 fn:load-xquery-module

Changes in 4.0 (next | previous)

  1. It has been clarified that loading a module has no effect on the static or dynamic context of the caller.  [Issue 725 PR 727 10 October 2023]

  2. The return type is now specified more precisely.  [Issue 883 PR 1072 19 March 2024]

  3. A new option is provided to allow the content of the loaded module to be supplied as a string.  [Issue 1329 PR 1333 22 July 2024]

Summary

Provides access to the public functions and global variables of a dynamically loaded XQuery library module.

Signature
fn:load-xquery-module(
$module-urias xs:string,
$optionsas map(*)?:= {}
) as load-xquery-module-record
Properties

This function is deterministic, context-dependent, and focus-dependent.

Rules

The function loads an implementation-defined set of modules having the target namespace $module-uri.

If the second argument is omitted or an empty sequence, the result is the same as calling the two-argument form with an empty map as the value of the $options argument.

The $options argument can be used to control the way in which the function operates. The option parameter conventions apply.

If the query module is retrieved as an external resource, this is subject to the trust levelXP of the calling code. In addition, the ability of the loaded query module to access additional resources is subject to the value of the supplied trusted option.

Note:

Versions of XQuery prior to 4.0 do not define any constraints on access to external resources. Many XQuery implementations, however, provide such mechanisms. An implementation of fn:load-xquery-module that allows execution of an untrustedXP query must ensure that the ability of that query to access resources is appropriately restricted, regardless of the version of XQuery in use.

record(
xquery-version?as xs:decimal,
trusted?as xs:boolean,
location-hints?as xs:string*,
content?as xs:string?,
context-item?as item()?,
variables?as map(xs:QName, item()*),
vendor-options?as map(xs:QName, item()*)
)
KeyValueMeaning

xquery-version?

The minimum level of the XQuery language that the processor must support.
  • Type: xs:decimal

  • Default: The version given in the prolog of the library module; or implementation-defined if this is absent.

trusted?

Indicates whether the returned query module is trusted to access external resources. This applies both to resources statically referenced in the query module (such as imported schemas and imported library modules), and to resources accessed dynamically by invoking functions in the retrieved module, for example by use of the fn:doc function.
  • Type: xs:boolean

  • Default: false()

trueThe loaded query has the same level of trust as the caller, and may therefore access all external resources available to the caller.
falseThe functions and variables in the returned XQuery module are untrustedXP, and are therefore unable to access external resources unless these have been made explicitly available by a trusted caller.

location-hints?

A sequence of URIs (in the form of xs:string values) which may be used or ignored in an implementation-defined way.
  • Type: xs:string*

  • Default: Empty sequence

content?

The content of the query module as a string. When this option is used, the location-hints option is ignored. The static base URI of the dynamically loaded module is the same as the executable base URIXP of the caller.
  • Type: xs:string?

  • Default: Empty sequence

context-item?

The item to be used as the initial context item when evaluating global variables in the library module. Supplying an empty sequence is equivalent to omitting the entry from the map, and indicates the absence of a context item. If the library module specifies a required type for the context item, then the supplied value must conform to this type, without conversion.
  • Type: item()?

  • Default: Absent

variables?

Values for external variables defined in the library module. Values must be supplied for external variables that have no default value, and may be supplied for external variables that do have a default value. The supplied value must conform to the required type of the variable, without conversion. The map contains one entry for each external variable: the key is the variable’s name, and the associated value is the variable’s value. The option parameter conventions do not apply to this contained map.
  • Type: map(xs:QName, item()*)

  • Default: An empty map

vendor-options?

Values for vendor-defined configuration options for the XQuery processor used to process the request. The key is the name of an option, expressed as a QName: the namespace URI of the QName should be a URI controlled by the vendor of the XQuery processor. The meaning of the associated value is implementation-defined. Implementations should ignore options whose names are in an unrecognized namespace. The option parameter conventions do not apply to this contained map.
  • Type: map(xs:QName, item()*)

  • Default: An empty map

The result of the function is a map R with two entries, as defined in 18.1 Record fn:load-xquery-module-record.

The static and dynamic context of the library module are established according to the rules in C Context Components XQ31.

It is implementation-defined whether constructs in the library module are evaluated in the same execution scope as the calling module.

The library module that is loaded may import other modules using an import module declaration. The result of fn:load-xquery-module does not include global variables or functions declared in such a transitively imported module. However, the options map supplied in the function call may (and if no default is defined, must) supply values for external variables declared in transitively loaded library modules.

The library module that is loaded may import schema declarations using an import schema declaration. It is implementation-defined whether schema components in the in-scope schema definitions of the calling module are automatically added to the in-scope schema definitions of the dynamically loaded module. The in-scope schema definitions of the calling and called modules must be consistent, according to the rules defined in 2.2.5 Consistency Constraints XQ31.

Where nodes are passed to or from the dynamically loaded module, for example as an argument or result of a function, they should if possible retain their node identity, their base URI, their type annotations, and their relationships to all other nodes in the containing tree (including ancestors and siblings). If this is not possible, for example because the only way of passing nodes to the chosen XQuery implementation is by serializing and re-parsing, then a node may be passed in the form of a deep copy, which may lose information about the identity of the node, about its ancestors and siblings, about its base URI, about its type annotations, and about its relationships to other nodes passed across the interface.

Error Conditions

If $module-uri is a zero length string, a dynamic error is raised [err:FOQM0001].

If the implementation is not able to find a library module with the specified target namespace, an error is raised [err:FOQM0002].

If a static error (including a statically detected type error) is encountered when processing the library module, a dynamic error is raised [err:FOQM0003].

If a value is supplied for the initial context item or for an external variable and the value does not conform to the required type declared in the dynamically loaded module, a dynamic error is raised [err:FOQM0005].

If no suitable XQuery processor is available, a dynamic error is raised [err:FOQM0006]. This includes (but is not limited to) the following cases:

  1. No XQuery processor is available;

  2. Use of the function has been disabled;

  3. No XQuery processor supporting the requested version of XQuery is available;

  4. No XQuery processor supporting the optional Module Feature is available.

If a dynamic error (including a dynamically detected type error) is encountered when processing the module (for example, when evaluating its global variables), the dynamic error is returned as is.

Notes

If a function declaration F in the loaded module declares (say) four parameters of which one is optional, its arity range will be from 3 to 4, so the result will include two function items corresponding to F#3 and F#4. In the lower-arity function item, F#3, the fourth parameter will take its default value. If the expression that initializes the default value is context sensitive, the static and dynamic context for its evaluation are the static and dynamic contexts of the fn:load-xquery-module function call itself.

As with all other functions in this specification, conformance requirements depend on the host language. For example, a host language might specify that provision of this function is optional, or that it is excluded entirely, or that implementations are required to support XQuery modules using a specified version of XQuery.

Even where support for this function is mandatory, it is recommended for security reasons that implementations should provide a user option to disable its use, or to disable aspects of its functionality.

The load-xquery-module function does not modify the static or dynamic context. Functions and variables from the loaded module become available within the result returned by the function, but they are not added to the static or dynamic context of the caller. This means, for example, that function-lookup will not locate functions from the loaded module.

Examples
Expression:
let $expr := "2 + 2"
let $module := `
  xquery version "4.0"; 
  module namespace dyn="http://example.com/dyn";
  declare %public variable $dyn:value := { $expr };
`
let $exec := load-xquery-module(
  "http://example.com/dyn",
  { 'content':$module }
)
let $variables := $exec?variables
return $variables( #Q{http://example.com/dyn}value )
Result:
4

21 Errors and diagnostics

21.1 Raising errors

In this document, as well as in [XQuery 4.0: An XML Query Language] and [XML Path Language (XPath) 4.0], the phrase “an error is raised” is used. Raising an error is equivalent to calling the fn:error function defined in this section with the provided error code. Except where otherwise specified, errors defined in this specification are dynamic errors. Some errors, however, are classified as type errors. Type errors are typically used where the presence of the error can be inferred from knowledge of the type of the actual arguments to a function, for example with a call such as fn:string(fn:abs#1). Host languages may allow type errors to be reported statically if they are discovered during static analysis.

When function specifications indicate that an error is to be raised, the notation “[error code ]” is used to specify an error code. Each error defined in this document is identified by an xs:QName that is in the http://www.w3.org/2005/xqt-errors namespace, represented in this document by the err prefix. It is this xs:QName that is actually passed as an argument to the fn:error function. Calling this function raises an error. For a more detailed treatment of error handing, see 2.3.3 Handling Dynamic Errors XP31.

The fn:error function is a general function that may be called as above but may also be called from [XQuery 4.0: An XML Query Language] or [XML Path Language (XPath) 4.0] applications with, for example, an xs:QName argument.

21.1.1 fn:error

Changes in 4.0 (next | previous)

  1. All three arguments are now optional, and each argument can be set to an empty sequence. Previously if $description was supplied, it could not be empty.  [Issue 895 PR 901 16 December 2023]

Summary

Calling the fn:error function raises an application-defined error.

Signature
fn:error(
$codeas xs:QName?:= (),
$descriptionas xs:string?:= (),
$valueas item()*:= .
) as item()*
Properties

This function is nondeterministic, context-independent, and focus-independent.

Rules

This function never returns a value. Instead it always raises an error. The effect of the error is identical to the effect of dynamic errors raised implicitly, for example when an incorrect argument is supplied to a function.

The parameters to the fn:error function supply information that is associated with the error condition and that is made available to a caller that asks for information about the error. The error may be caught either by the host language (using a try/catch construct in XSLT or XQuery, for example), or by the calling application or external processing environment. The way in which error information is returned to the external processing environment is implementation-dependent.

There are three pieces of information that may be associated with an error.

  • The $code is an error code that distinguishes this error from others. It is an xs:QName; the namespace URI conventionally identifies the component, subsystem, or authority responsible for defining the meaning of the error code, while the local part identifies the specific error condition. The namespace URI http://www.w3.org/2005/xqt-errors is used for errors defined in this specification; other namespace URIs may be used for errors defined by the application.

    If the external processing environment expects the error code to be returned as a URI or a string rather than as an xs:QName, then an error code with namespace URI NS and local part LP will be returned in the form NS#LP. The namespace URI part of the error code should therefore not include a fragment identifier.

    If no value is supplied for the $code argument, or if the value supplied is an empty sequence, the effective value of the error code is fn:QName('http://www.w3.org/2005/xqt-errors', 'err:FOER0000').

  • The $description is a natural-language description of the error condition.

    If no value is supplied for the $description argument, or if the value suppliedvalue is an empty sequence, then the effective value of the description is implementation-dependent.

  • The $value is an arbitrary value used to convey additional information about the error, and may be used in any way the application chooses.

    If no value is supplied for the $value argument or if the value supplied is an empty sequence, then the effective value of the error object is implementation-dependent.

Error Conditions

This function always raises a dynamic error. By default, it raises [err:FOER0000]

Notes

The value of the $description parameter may need to be localized.

Since the function never returns a value, the declared return type of item()* is a convenient fiction. It is relevant insofar as a function item such as error#1 may (as a consequence of function coercion) be supplied in contexts where a function with a more specific return type is required.

Any QName may be used as an error code; there are no reserved names or namespaces. The error is always classified as a dynamic error, even if the error code used is one that is normally used for static errors or type errors.

Examples
Expression:

error()

Result:

Raises error FOER0000.

(This returns the URI http://www.w3.org/2005/xqt-errors#FOER0000 (or the corresponding xs:QName) to the external processing environment, unless the error is caught using a try/catch construct in the host language.)

Expression:
error(
  QName('http://www.example.com/HR', 'myerr:toohighsal'),
  'Salary is too high'
)
Result:

Raises error myerr:toohighsal.

(This returns http://www.example.com/HR#toohighsal and the xs:string"Salary is too high" (or the corresponding xs:QName) to the external processing environment, unless the error is caught using a try/catch construct in the host language.)

21.2 Diagnostic tracing

21.2.1 fn:trace

Changes in 4.0 (next | previous)

  1. The $label argument can now be set to an empty sequence. Previously if $label was supplied, it could not be empty.  [Issue 895 PR 901 16 December 2023]

Summary

Provides an execution trace intended to be used in debugging queries.

Signature
fn:trace(
$inputas item()*,
$labelas xs:string?:= ()
) as item()*
Properties

This function is deterministic, context-independent, and focus-independent.

Rules

The function returns $input, unchanged.

In addition, the values of $input, typically serialized and converted to an xs:string, and $label (if supplied and non-empty) may be output to an implementation-defined destination.

Any serialization of the implementation’s trace output must not raise an error. This can be achieved (for example) by using a serialization method that can handle arbitrary input, such as the adaptive output method (see 10 Adaptive Output Method SER31).

The format of the trace output and its order are implementation-dependent. Therefore, the order in which the output appears is not predictable. This also means that if dynamic errors occur (whether or not they are caught using try/catch), it may be unpredictable whether any output is reported before the error occurs.

Notes

If the trace information is unrelated to a specific value, fn:message can be used instead.

Examples

Consider a situation in which a user wants to investigate the actual value passed to a function. Assume that in a particular execution, $v is an xs:decimal with value 124.84. Writing fn:trace($v, 'the value of $v is:') will return $v. The processor may output "124.84" and "the value of $v is:" to an implementation-defined destination.

The following two XPath expressions are identical, but only the second provides trace feedback to the user:

  • //book[xs:decimal(@price) gt 100]

  • //book[xs:decimal(@price) gt 100] => trace('books more expensive than €100:')

21.2.2 fn:message

Changes in 4.0 (next | previous)

  1. New in 4.0  [Issues 574 651 PRs 629 803 7 November 2023]

Summary

Outputs trace information and discards the result.

Signature
fn:message(
$inputas item()*,
$labelas xs:string?:= ()
) as empty-sequence()
Properties

This function is deterministic, context-independent, and focus-independent.

Rules

Similar to fn:trace, the values of $input, typically serialized and converted to an xs:string, and $label (if supplied and non-empty) may be output to an implementation-defined destination.

In contrast to fn:trace, the function returns an empty sequence.

Any serialization of the implementation’s log output must not raise an error. This can e.g. be achieved by using a serialization method that can handle arbitrary input, such as the 10 Adaptive Output Method SER31.

The format of the log output and its order are implementation-dependent. Therefore, the order in which the output appears is not predictable. This also means that if dynamic errors occur (whether or not they are caught using try/catch), it may be unpredictable whether any output is logged before the error occurs.

Notes

The function can be used for debugging. It can also be helpful in productive environments, e.g. to store dynamic input and evaluations to log files.

Examples

The following two XPath expressions are identical, but only the second logs any feedback:

  • //book[xs:decimal(@price) lt 1000]

  • //book[if (xs:decimal(@price) lt 1000) then true() else message(@price, @title || ' is unexpectedly expensive: ')]

G Implementation-defined features (Non-Normative)

  1. It is implementation-defined which version of Unicode is supported, but it is recommended that the most recent version of Unicode be used. (See Conformance.)

  2. It is implementation-defined whether the type system is based on XML Schema 1.0 or XML Schema 1.1. (See Conformance.)

  3. It is implementation-defined whether definitions that rely on XML (for example, the set of valid XML characters) should use the definitions in XML 1.0 or XML 1.1. (See Conformance.)

  4. Implementations may attach an implementation-defined meaning to options in the map that are not described in this specification. These options should use values of type xs:QName as the option names, using an appropriate namespace. (See Options.)

  5. It is implementation-defined which version of [The Unicode Standard] is supported, but it is recommended that the most recent version of Unicode be used. (See Strings, characters, and codepoints.)

  6. [Definition] Some functions (such as fn:in-scope-prefixes, fn:load-xquery-module, and fn:unordered) produce result sequences or result maps in an implementation-defined or implementation-dependent order. In such cases two calls with the same arguments are not guaranteed to produce the results in the same order. These functions are said to be nondeterministic with respect to ordering. (See Properties of functions.)

  7. Where the results of a function are described as being (to a greater or lesser extent) implementation-defined or implementation-dependent, this does not by itself remove the requirement that the results should be deterministic: that is, that repeated calls with the same explicit and implicit arguments must return identical results. (See Properties of functions.)

  8. They may provide an implementation-defined mechanism that allows users to choose between raising an error and returning a result that is modulo the largest representable integer value. See [ISO 10967]. (See Arithmetic operators on numeric values.)

  9. For xs:decimal values, let N be the number of digits of precision supported by the implementation, and let M (M <= N) be the minimum limit on the number of digits required for conformance (18 digits for XSD 1.0, 16 digits for XSD 1.1). Then for addition, subtraction, and multiplication operations, the returned result should be accurate to N digits of precision, and for division and modulus operations, the returned result should be accurate to at least M digits of precision. The actual precision is implementation-defined. If the number of digits in the mathematical result exceeds the number of digits that the implementation retains for that operation, the result is truncated or rounded in an implementation-defined manner. (See Arithmetic operators on numeric values.)

  10. The [IEEE 754-2019] specification also describes handling of two exception conditions called divideByZero and invalidOperation. The IEEE divideByZero exception is raised not only by a direct attempt to divide by zero, but also by operations such as log(0). The IEEE invalidOperation exception is raised by attempts to call a function with an argument that is outside the function’s domain (for example, sqrt(-1) or log(-1)). Although IEEE defines these as exceptions, it also defines “default non-stop exception handling” in which the operation returns a defined result, typically positive or negative infinity, or NaN. With this function library, these IEEE exceptions do not cause a dynamic error at the application level; rather they result in the relevant function or operator returning the defined non-error result. The underlying IEEE exception may be notified to the application or to the user by some implementation-defined warning condition, but the observable effect on an application using the functions and operators defined in this specification is simply to return the defined result (typically -INF, +INF, or NaN) with no error. (See Arithmetic operators on numeric values.)

  11. The [IEEE 754-2019] specification distinguishes two NaN values: a quiet NaN and a signaling NaN. These two values are not distinguishable in the XDM model: the value spaces of xs:float and xs:double each include only a single NaN value. This does not prevent the implementation distinguishing them internally, and triggering different implementation-defined warning conditions, but such distinctions do not affect the observable behavior of an application using the functions and operators defined in this specification. (See Arithmetic operators on numeric values.)

  12. The implementation may adopt a different algorithm provided that it is equivalent to this formulation in all cases where implementation-dependent or implementation-defined behavior does not affect the outcome, for example, the implementation-defined precision of the result of xs:decimal division. (See op:numeric-integer-divide.)

  13. There may be implementation-defined limits on the precision available. If the requested $precision is outside this range, it should be adjusted to the nearest value supported by the implementation. (See fn:divide-decimals.)

  14. There may be implementation-defined limits on the precision available. If the requested $precision is outside this range, it should be adjusted to the nearest value supported by the implementation. (See fn:round.)

  15. There may be implementation-defined limits on the precision available. If the requested $precision is outside this range, it should be adjusted to the nearest value supported by the implementation. (See fn:round-half-to-even.)

  16. XSD 1.1 allows the string +INF as a representation of positive infinity; XSD 1.0 does not. It is implementation-defined whether XSD 1.1 is supported. (See fn:number.)

  17. Any other format token, which indicates a numbering sequence in which that token represents the number 1 (one) (but see the note below). It is implementation-defined which numbering sequences, additional to those listed above, are supported. If an implementation does not support a numbering sequence represented by the given token, it must use a format token of 1. (See fn:format-integer.)

  18. For all format tokens other than a digit-pattern, there may be implementation-defined lower and upper bounds on the range of numbers that can be formatted using this format token; indeed, for some numbering sequences there may be intrinsic limits. For example, the format token U+2460 (CIRCLED DIGIT ONE, ) has a range imposed by the Unicode character repertoire — zero to 20 in Unicode versions prior to 3.2, or zero to 50 in subsequent versions. For the numbering sequences described above any upper bound imposed by the implementation must not be less than 1000 (one thousand) and any lower bound must not be greater than 1. Numbers that fall outside this range must be formatted using the format token 1. (See fn:format-integer.)

  19. The set of languages for which numbering is supported is implementation-defined. If the $language argument is absent, or is set to an empty sequence, or is invalid, or is not a language supported by the implementation, then the number is formatted using the default language from the dynamic context. (See fn:format-integer.)

  20. ...either a or t, to indicate alphabetic or traditional numbering respectively, the default being implementation-defined. (See fn:format-integer.)

  21. The string of characters between the parentheses, if present, is used to select between other possible variations of cardinal or ordinal numbering sequences. The interpretation of this string is implementation-defined. No error occurs if the implementation does not define any interpretation for the defined string. (See fn:format-integer.)

  22. It is implementation-defined what combinations of values of the format token, the language, and the cardinal/ordinal modifier are supported. If ordinal numbering is not supported for the combination of the format token, the language, and the string appearing in parentheses, the request is ignored and cardinal numbers are generated instead. (See fn:format-integer.)

  23. The use of the a or t modifier disambiguates between numbering sequences that use letters. In many languages there are two commonly used numbering sequences that use letters. One numbering sequence assigns numeric values to letters in alphabetic sequence, and the other assigns numeric values to each letter in some other manner traditional in that language. In English, these would correspond to the numbering sequences specified by the format tokens a and i. In some languages, the first member of each sequence is the same, and so the format token alone would be ambiguous. In the absence of the a or t modifier, the default is implementation-defined. (See fn:format-integer.)

  24. The static context provides a set of decimal formats. One of the decimal formats is unnamed, the others (if any) are identified by a QName. There is always an unnamed decimal format available, but its contents are implementation-defined. (See Defining a decimal format.)

  25. IEEE states that the preferred quantum is language-defined. In this specification, it is implementation-defined. (See Trigonometric and exponential functions.)

  26. IEEE defines various rounding algorithms for inexact results, and states that the choice of rounding direction, and the mechanisms for influencing this choice, are language-defined. In this specification, the rounding direction and any mechanisms for influencing it are implementation-defined. (See Trigonometric and exponential functions.)

  27. The map returned by the fn:random-number-generator function may contain additional entries beyond those specified here, but it must match the record type defined above. The meaning of any additional entries is implementation-defined. To avoid conflict with any future version of this specification, the keys of any such entries should start with an underscore character. (See fn:random-number-generator.)

  28. It is no longer automatically an error if the input contains a codepoint that is not valid in XML. Instead, the codepoint must be a permitted character. The set of permitted characters is implementation-defined, but it is recommended that all Unicode characters should be accepted. (See fn:codepoints-to-string.)

  29. If two query parameters use the same keyword then the last one wins. If a query parameter uses a keyword or value which is not defined in this specification then the meaning is implementation-defined. If the implementation recognizes the meaning of the keyword and value then it should interpret it accordingly; if it does not recognize the keyword or value then if the fallback parameter is present with the value no it should reject the collation as unsupported, otherwise it should ignore the unrecognized parameter. (See The Unicode Collation Algorithm.)

  30. The following query parameters are defined. If any parameter is absent, the default is implementation-defined except where otherwise stated. The meaning given for each parameter is non-normative; the normative specification is found in [UTS #35]. (See The Unicode Collation Algorithm.)

  31. Because the set of collations that are supported is implementation-defined, an implementation has the option to support all collation URIs, in which case it will never raise this error. (See Choosing a collation.)

  32. The properties available are as defined for the Unicode Collation Algorithm (see 5.3.4 The Unicode Collation Algorithm). Additional implementation-defined properties may be specified as described in the rules for UCA collation URIs. (See fn:collation.)

  33. It is possible to define collations that do not have the ability to generate collation keys. Supplying such a collation will cause the function to fail. The ability to generate collation keys is an implementation-defined property of the collation. (See fn:collation-key.)

  34. Conforming implementations must support normalization form NFC and may support normalization forms NFD, NFKC, NFKD, and FULLY-NORMALIZED. They may also support other normalization forms with implementation-defined semantics. (See fn:normalize-unicode.)

  35. It is implementation-defined which version of Unicode (and therefore, of the normalization algorithms and their underlying data) is supported by the implementation. See [UAX #15] for details of the stability policy regarding changes to the normalization rules in future versions of Unicode. If the input string contains codepoints that are unassigned in the relevant version of Unicode, or for which no normalization rules are defined, the fn:normalize-unicode function leaves such codepoints unchanged. If the implementation supports the requested normalization form then it must be able to handle every input string without raising an error. (See fn:normalize-unicode.)

  36. It is possible to define collations that do not have the ability to decompose a string into units suitable for substring matching. An argument to a function defined in this section may be a URI that identifies a collation that is able to compare two strings, but that does not have the capability to split the string into collation units. Such a collation may cause the function to fail, or to give unexpected results, or it may be rejected as an unsuitable argument. The ability to decompose strings into collation units is an implementation-defined property of the collation. The fn:collation-available function can be used to ask whether a particular collation has this property. (See Functions based on substring matching.)

  37. The result of the function will always be such that validation against this schema would succeed. However, it is implementation-defined whether the result is typed or untyped, that is, whether the elements and attributes in the returned tree have type annotations that reflect the result of validating against this schema. (See fn:analyze-string.)

  38. Some URI schemes are hierarchical and some are non-hierarchical. Implementations must treat the following schemes as non-hierarchical: jar, mailto, news, tag, tel, and urn. Whether additional schemes are known to be non-hierarchical implementation-defined. If a scheme is not known to be non-hierarchical, it must be treated as hierarchical. (See Parsing and building URIs.)

  39. If the omit-default-ports option is true, the port is discarded and set to the empty sequence if the port number is the same as the default port for the given scheme. Implementations should recognize the default ports for http (80), https (443), ftp (21), and ssh (22). Exactly which ports are recognized is implementation-defined. (See fn:parse-uri.)

  40. If the omit-default-ports option is true then the $port is set to the empty sequence if the port number is the same as the default port for the given scheme. Implementations should recognize the default ports for http (80), https (443), ftp (21), and ssh (22). Exactly which ports are recognized is implementation-defined. (See fn:build-uri.)

  41. Processors may support a greater range and/or precision. The limits are implementation-defined. (See Limits and precision.)

  42. Similarly, a processor may be unable accurately to represent the result of dividing a duration by 2, or multiplying a duration by 0.5. A processor that limits the precision of the seconds component of duration values must deliver a result that is as close as possible to the mathematically precise result, given these limits; if two values are equally close, the one that is chosen is implementation-defined. (See Limits and precision.)

  43. All conforming processors must support year values in the range 1 to 9999, and a minimum fractional second precision of 1 millisecond or three digits (i.e., s.sss). However, processors may set larger implementation-defined limits on the maximum number of digits they support in these two situations. Processors may also choose to support the year 0 and years with negative values. The results of operations on dates that cross the year 0 are implementation-defined. (See Limits and precision.)

  44. Similarly, a processor that limits the precision of the seconds component of date and time or duration values may need to deliver a rounded result for arithmetic operations. Such a processor must deliver a result that is as close as possible to the mathematically precise result, given these limits: if two values are equally close, the one that is chosen is implementation-defined. (See Limits and precision.)

  45. ...the format token n, N, or Nn, indicating that the value of the component is to be output by name, in lower-case, upper-case, or title-case respectively. Components that can be output by name include (but are not limited to) months, days of the week, timezones, and eras. If the processor cannot output these components by name for the chosen calendar and language then it must use an implementation-defined fallback representation. (See The picture string.)

  46. ...indicates alphabetic or traditional numbering respectively, the default being implementation-defined. This has the same meaning as in the second argument of fn:format-integer. (See The picture string.)

  47. The sequence of characters in the (adjusted) first presentation modifier is reversed (for example, 999'### becomes ###'999). If the result is not a valid decimal digit pattern, then the output is implementation-defined. (See Formatting Fractional Seconds.)

  48. The output for these components is entirely implementation-defined. The default presentation modifier for these components is n, indicating that they are output as names (or conventional abbreviations), and the chosen names will in many cases depend on the chosen language: see 9.8.4.8 The language, calendar, and place arguments. (See Formatting Other Components.)

  49. The set of languages, calendars, and places that are supported in the date formatting functions is implementation-defined. When any of these arguments is omitted or is an empty sequence, an implementation-defined default value is used. (See The language, calendar, and place arguments.)

  50. The choice of the names and abbreviations used in any given language is implementation-defined. For example, one implementation might abbreviate July as Jul while another uses Jly. In German, one implementation might represent Saturday as Samstag while another uses Sonnabend. Implementations may provide mechanisms allowing users to control such choices. (See The language, calendar, and place arguments.)

  51. The choice of the names and abbreviations used in any given language for calendar units such as days of the week and months of the year is implementation-defined. (See The language, calendar, and place arguments.)

  52. The calendar value if present must be a valid EQName (dynamic error: [err:FOFD1340]). If it is a lexical QName then it is expanded into an expanded QName using the statically known namespaces; if it has no prefix then it represents an expanded-QName in no namespace. If the expanded QName is in no namespace, then it must identify a calendar with a designator specified below (dynamic error: [err:FOFD1340]). If the expanded QName is in a namespace then it identifies the calendar in an implementation-defined way. (See The language, calendar, and place arguments.)

  53. At least one of the above calendars must be supported. It is implementation-defined which calendars are supported. (See The language, calendar, and place arguments.)

  54. If the arguments to fn:function-lookup identify a function that is present in the static context of the function call, the function will always return the same function that a static reference to this function would bind to. If there is no such function in the static context, then the results depend on what is present in the dynamic context, which is implementation-defined. (See fn:function-lookup.)

  55. It is to some extent implementation-defined whether two maps or arrays have the same function identity. Processors should ensure as a minimum that when a variable $m is bound to a map or array, calling jtree($m) more than once (with the same variable reference) will deliver the same JNode each time. (See fn:jtree.)

  56. The requirement to deliver a deterministic result has performance implications, and for this reason implementations may provide a user option to evaluate the function without a guarantee of determinism. The manner in which any such option is provided is implementation-defined. If the user has not selected such an option, a call of the function must either return a deterministic result or must raise a dynamic error [err:FODC0003]. (See fn:doc.)

  57. Various aspects of this processing are implementation-defined. Implementations may provide external configuration options that allow any aspect of the processing to be controlled by the user. In particular:... (See fn:doc.)

  58. It is implementation-defined whether DTD validation and/or schema validation is applied to the source document. (See fn:doc.)

  59. The effect of a fragment identifier in the supplied URI is implementation-defined. One possible interpretation is to treat the fragment identifier as an ID attribute value, and to return a document node having the element with the selected ID value as its only child. (See fn:doc.)

  60. By default, this function is deterministic. This means that repeated calls on the function with the same argument will return the same result. However, for performance reasons, implementations may provide a user option to evaluate the function without a guarantee of determinism. The manner in which any such option is provided is implementation-defined. If the user has not selected such an option, a call to this function must either return a deterministic result or must raise a dynamic error [err:FODC0003]. (See fn:collection.)

  61. By default, this function is deterministic. This means that repeated calls on the function with the same argument will return the same result. However, for performance reasons, implementations may provide a user option to evaluate the function without a guarantee of determinism. The manner in which any such option is provided is implementation-defined. If the user has not selected such an option, a call to this function must either return a deterministic result or must raise a dynamic error [err:FODC0003]. (See fn:uri-collection.)

  62. It is no longer automatically an error if the resource (after decoding) contains a codepoint that is not valid in XML. Instead, the codepoint must be a permitted character. The set of permitted characters is implementation-defined, but it is recommended that all Unicode characters should be accepted. (See fn:unparsed-text.)

  63. ...utf-8, or a value that results from implementation-defined heuristics. (See fn:unparsed-text.)

  64. The fact that the resolution of URIs is defined by a mapping in the dynamic context means that in effect, various aspects of the behavior of this function are implementation-defined. Implementations may provide external configuration options that allow any aspect of the processing to be controlled by the user. In particular:... (See fn:unparsed-text.)

  65. The fact that the resolution of URIs is defined by a mapping in the dynamic context means that in effect, various aspects of the behavior of this function are implementation-defined. Implementations may provide external configuration options that allow any aspect of the processing to be controlled by the user. In particular:... (See fn:unparsed-binary.)

  66. The collation used for matching names is implementation-defined, but must be the same as the collation used to ensure that the names of all environment variables are unique. (See fn:environment-variable.)

  67. Except to the extent defined by these options, the precise process used to construct the XDM instance is implementation-defined. In particular, it is implementation-defined whether an XML 1.0 or XML 1.1 parser is used. (See fn:parse-xml.)

  68. Options set in $options may be supplemented or modified based on configuration options defined externally using implementation-defined mechanisms. (See fn:parse-xml.)

  69. Except as explicitly defined, the precise process used to construct the XDM instance is implementation-defined. In particular, it is implementation-defined whether an XML 1.0 or XML 1.1 parser is used. (See fn:parse-xml-fragment.)

  70. If the second argument is omitted, or is supplied in the form of an output:serialization-parameters element, then the values of any serialization parameters that are not explicitly specified is implementation-defined, and may depend on the context. (See fn:serialize.)

  71. A list of target namespaces identifying schema components to be used for validation. The way in which the processor locates schema components for the specified target namespaces is implementation-defined. A zero-length string denotes a no-namespace schema.... (See fn:xsd-validator.)

  72. Set to the decimal value 1.0 or 1.1 to indicate which version of XSD is to be used. The default is implementation-defined. A processor may use a later version of XSD than the version requested, but must not use an earlier version.... (See fn:xsd-validator.)

  73. The XSD specification allows a schema to be used for validation even when it contains unresolved references to absent schema components. It is implementation-defined whether this function allows the schema to be incomplete in this way. For example, some processors might allow validation using a schema in which an element declaration contains a reference to a type declaration that is not present in the schema, provided that the element declaration is never needed in the course of a particular validation episodes. (See fn:xsd-validator.)

  74. ...error-details as map(*)*. This field is present only when (a) the option return-error-details was set to true, and (b) the supplied document was found to be invalid. The value is a sequence of maps, each containing details of one invalidity that was found. The precise details of the invalidities are implementation-defined, but they may include the following fields, if the information is available:... (See fn:xsd-validator.)

  75. Because the [DOM: Living Standard] and [HTML: Living Standard] are not fixed, it is implementation-defined which versions are used. (See XDM Mapping from HTML DOM Nodes.)

  76. If an implementation allows these nodes to be passed in via an API or similar mechanism, their behaviour is implementation-defined. (See XDM Mapping from HTML DOM Nodes.)

  77. If the local name contains a character that is not a valid XML NameStartChar or NameChar, then an implementation-defined replacement string is used. The result must be a valid NCName. (See node-name Accessor.)

  78. If the local name contains a character that is not a valid XML NameStartChar or NameChar, then an implementation-defined replacement string is used. The result must be a valid NCName. (See node-name Accessor.)

  79. The input may contain deviations from the grammar of [RFC 7159], which are handled in an implementation-defined way. (Note: some popular extensions include allowing quotes on keys to be omitted, allowing a comma to appear after the last item in an array, allowing leading zeroes in numbers, and allowing control characters such as tab and newline to be present in unescaped form.) Since the extensions accepted are implementation-defined, an error may be raised [err:FOJS0001] if the input does not conform to the grammar. (See fn:parse-json.)

  80. The supplied function is called to process the string value of any JSON number in the input. By default, numbers are processed by converting to xs:double using the XPath casting rules. Supplying the value xs:decimal#1 will instead convert to xs:decimal (which potentially retains more precision, but disallows exponential notation), while supplying a function that casts to (xs:decimal | xs:double) will treat the value as xs:decimal if there is no exponent, or as xs:double otherwise. Supplying the value fn:identity#1 causes the value to be retained unchanged as an xs:untypedAtomic. If the liberal option is false (the default), then the supplied number-parser is called if and only if the value conforms to the JSON grammar for numbers (for example, a leading plus sign and redundant leading zeroes are not allowed). If the liberal option is true then it is also called if the value conforms to an implementation-defined extension of this grammar. (See fn:parse-json.)

  81. It is no longer automatically an error if the input contains a codepoint that is not valid in XML. Instead, the codepoint must be a permitted character. The set of permitted characters is implementation-defined, but it is recommended that all Unicode characters should be accepted. (See fn:json-doc.)

  82. The input may contain deviations from the grammar of [RFC 7159], which are handled in an implementation-defined way. (Note: some popular extensions include allowing quotes on keys to be omitted, allowing a comma to appear after the last item in an array, allowing leading zeroes in numbers, and allowing control characters such as tab and newline to be present in unescaped form.) Since the extensions accepted are implementation-defined, an error may be raised (see below) if the input does not conform to the grammar. (See fn:json-to-xml.)

  83. Default: Implementation-defined. (See fn:json-to-xml.)

  84. Indicates that the resulting XDM instance must be typed; that is, the element and attribute nodes must carry the type annotations that result from validation against the schema given at D.2 Schema for the result of fn:json-to-xml, or against an implementation-defined schema if the liberal option has the value true. (See fn:json-to-xml.)

  85. The result of the function will always be such that validation against this schema would succeed. However, it is implementation-defined whether the result is typed or untyped, that is, whether the elements and attributes in the returned tree have type annotations that reflect the result of validating against this schema. (See fn:csv-to-xml.)

  86. Additional, implementation-defined options may be available, for example, to control aspects of the XML serialization, to specify the grammar start symbol, or to produce output formats other than XML. (See fn:invisible-xml.)

  87. Default: The version given in the prolog of the library module; or implementation-defined if this is absent. (See fn:load-xquery-module.)

  88. A sequence of URIs (in the form of xs:string values) which may be used or ignored in an implementation-defined way.... (See fn:load-xquery-module.)

  89. Values for vendor-defined configuration options for the XQuery processor used to process the request. The key is the name of an option, expressed as a QName: the namespace URI of the QName should be a URI controlled by the vendor of the XQuery processor. The meaning of the associated value is implementation-defined. Implementations should ignore options whose names are in an unrecognized namespace. The option parameter conventions do not apply to this contained map.... (See fn:load-xquery-module.)

  90. It is implementation-defined whether constructs in the library module are evaluated in the same execution scope as the calling module. (See fn:load-xquery-module.)

  91. The library module that is loaded may import schema declarations using an import schema declaration. It is implementation-defined whether schema components in the in-scope schema definitions of the calling module are automatically added to the in-scope schema definitions of the dynamically loaded module. The in-scope schema definitions of the calling and called modules must be consistent, according to the rules defined in 2.2.5 Consistency Constraints XQ31. (See fn:load-xquery-module.)

  92. Default: Implementation-defined. (See fn:transform.)

  93. Default: Implementation-defined. (See fn:transform.)

  94. If the implementation provides a way of writing or invoking functions with side-effects, this post-processing function might be used to save a copy of the result document to persistent storage. For example, if the implementation provides access to the EXPath File library [EXPath], then a serialized document might be written to filestore by calling the file:write function. Similar mechanisms might be used to issue an HTTP POST request that posts the result to an HTTP server, or to send the document to an email recipient. The semantics of calling functions with side-effects are entirely implementation-defined. (See fn:transform.)

  95. Calls to fn:transform can potentially have side-effects even in the absence of the post-processing option, because the XSLT specification allows a stylesheet to invoke extension functions that have side-effects. The semantics in this case are implementation-defined. (See fn:transform.)

  96. A string intended to be used as the static base URI of the principal stylesheet module. This value must be used if no other static base URI is available. If the supplied stylesheet already has a base URI (which will generally be the case if the stylesheet is supplied using stylesheet-node or stylesheet-location) then it is implementation-defined whether this parameter has any effect. If the value is a relative reference, it is resolved against the executable base URIXP of the fn:transform function call.... (See fn:transform.)

  97. Values for vendor-defined configuration options for the XSLT processor used to process the request. The key is the name of an option, expressed as a QName: the namespace URI of the QName should be a URI controlled by the vendor of the XSLT processor. The meaning of the associated value is implementation-defined. Implementations should ignore options whose names are in an unrecognized namespace. Default is an empty map.... (See fn:transform.)

  98. It is implementation-defined whether the XSLT transformation is executed within the same execution scope as the calling code. (See fn:transform.)

  99. XSLT 1.0 does not define any error codes, so this is the likely outcome with an XSLT 1.0 processor. XSLT 2.0 and 3.0 do define error codes, but some APIs do not expose them. If multiple errors are signaled by the transformation (which is most likely to happen with static errors) then the error code should where possible be that of one of these errors, chosen arbitrarily; the processor may make details of additional errors available to the application in an implementation-defined way. (See fn:transform.)

  100. In addition, the values of $input, typically serialized and converted to an xs:string, and $label (if supplied and non-empty) may be output to an implementation-defined destination. (See fn:trace.)

  101. Consider a situation in which a user wants to investigate the actual value passed to a function. Assume that in a particular execution, $v is an xs:decimal with value 124.84. Writing fn:trace($v, 'the value of $v is:') will return $v. The processor may output "124.84" and "the value of $v is:" to an implementation-defined destination. (See fn:trace.)

  102. Similar to fn:trace, the values of $input, typically serialized and converted to an xs:string, and $label (if supplied and non-empty) may be output to an implementation-defined destination. (See fn:message.)

  103. If ST is xs:float or xs:double, then TV is the xs:decimal value, within the set of xs:decimal values that the implementation is capable of representing, that is numerically closest to SV. If two values are equally close, then the one that is closest to zero is chosen. If SV is too large to be accommodated as an xs:decimal, (see [XML Schema Part 2: Datatypes Second Edition] for implementation-defined limits on numeric values) a dynamic error is raised [err:FOCA0001]. If SV is one of the special xs:float or xs:double values NaN, INF, or -INF, a dynamic error is raised [err:FOCA0002]. (See Casting to xs:decimal.)

  104. In casting to xs:decimal or to a type derived from xs:decimal, if the value is not too large or too small but nevertheless cannot be represented accurately with the number of decimal digits available to the implementation, the implementation may round to the nearest representable value or may raise a dynamic error [err:FOCA0006]. The choice of rounding algorithm and the choice between rounding and error behavior is implementation-defined. (See Casting from xs:string and xs:untypedAtomic.)

  105. If ST is xs:decimal, xs:float or xs:double, then TV is SV with the fractional part discarded and the value converted to xs:integer. Thus, casting 3.1456 returns 3 while -17.89 returns -17. Casting 3.124E1 returns 31. If SV is too large to be accommodated as an integer, (see [XML Schema Part 2: Datatypes Second Edition] for implementation-defined limits on numeric values) a dynamic error is raised [err:FOCA0003]. If SV is one of the special xs:float or xs:double values NaN, INF, or -INF, a dynamic error is raised [err:FOCA0002]. (See Casting to xs:integer.)

  106. The tz timezone database, available at http://www.iana.org/time-zones. It is implementation-defined which version of the database is used. (See IANA Timezone Database.)

  107. Unicode Standard Annex #15: Unicode Normalization Forms. Ed. Mark Davis and Ken Whistler, Unicode Consortium. The current version is 16.0.0, dated 2024-08-14. As with [The Unicode Standard], the version to be used is implementation-defined. Available at: http://www.unicode.org/reports/tr15/. (See UAX #15.)

  108. Unicode Standard Annex #29: Unicode Text Segmentation. Ed. Josh Hadley, Unicode Consortium. The current version is 16.0.0, dated 2024-08-28. As with [The Unicode Standard], the version to be used is implementation-defined. Available at: http://www.unicode.org/reports/tr29/. (See UAX #29.)

  109. The Unicode Consortium, Reading, MA, Addison-Wesley, 2016. The Unicode Standard as updated from time to time by the publication of new versions. See http://www.unicode.org/standard/versions/ for the latest version and additional information on versions of the standard and of the Unicode Character Database. The version of Unicode to be used is implementation-defined, but implementations are recommended to use the latest Unicode version; currently, Version 9.0.0. (See The Unicode Standard.)

  110. Unicode Technical Standard #10: Unicode Collation Algorithm. Ed. Mark Davis and Ken Whistler, Unicode Consortium. The current version is 16.0.0, dated 2024-08-22. As with [The Unicode Standard], the version to be used is implementation-defined. Available at: http://www.unicode.org/reports/tr10/. (See UTS #10.)

  111. Unicode Technical Standard #35: Unicode Locale Data Markup Language. Ed Mark Davis et al, Unicode Consortium. The current version is 47, dated 2025-03-11. As with [The Unicode Standard], the version to be used is implementation-defined. Available at: http://www.unicode.org/reports/tr35/. (See UTS #35.)