Project

General

Profile

Actions

OUTDATED

Please see up-to-date documentation under http://cybertaxonomy.eu/cdmlib/rest-api.html.


Developers implementation notes are found in CdmRestServicesImplementationNotes.


CDM REST Services 2.0

The CDM REST Services are a web based interface to resources stored in a CDM Community Server. The RESTful architecture allows accessing the various resources like Taxa, Names, References, Media, etc by stable URIs. Due to security constraints and to assure the integration of data, currently only read operations (= HTTP GET) are permitted, write operations will be available in the near future.

In contrast to the former CDM REST Services 1.0 the new architecture directly exposes domain model entities. Whereas the version 1.0 still was build using the DTO/Assembler pattern the new implementation provides direct serializations of the objects as they are stored in the CDM where ever possible. For the external representations, like LSIDs and TDWG data exchange schema like TCS however using DTOs is unavoidable. Now for the API Service there is no longer a difference between the data model used to store and manage CDM objects and another one used to transfer them to web based clients. Thereby it has become much easier to use the web service. The same account also for the Portal Service except that this service adds some fields like localized representations and to the pure CDM entities.

Service Sections

The CDM REST Services architecture is functionally separated into four different parts:

  • The API Service a clean RESTful bit, which will expose data in a modular, normalized way. It is a more-or-less one-to-one concordance between URIs and service api methods.

  • The Portal Service which is specially taliored for the needs of dataportals which will primarily display "Species Page". Thus this service will be provide denormalized pages which contain a specific assemblys of information.

  • The External Services are supporting non CDM applications and services like for example a map generation service, LSID Services.

  • The Classification Service exposes special DTOs which combine data from the TaxonBase@, @TaxonNode and from the Classification entities.

Detailed descriptions of the services are available below.

Object Boundaries

Nearly all CDM entities are related to each other more or less dicrectly or indirectly and thus forming a huge object graph. A web services however should only deliver a specific object perhaps with some attached associated objects, so it id crucial to draw the line quite sensible between the objects in question and the full object graph. The CDM Service solves this by selectively initializing CDM entities.

The primary idea is that the API Service delivers the requested object with all its *toOne relations. Associated objects of the requested object which are at the many side of the *toMany relations are available through URIs which map the fieldname of the *toMany relation. Transient fields are not serialized except of the titleCache property, this one and serialized and thus initialized for each IdentifiableEntity@. The initialization of the @titleCache property is performed by the CacheStrategie of the specific cdm class and usually spans multiple associated entities of variable depth of object nesting.

In contrast the Portal Service, often adds *toMany relations and transient fields to the requested objects. It even may deliver sub object graphs with a depth of an arbitrary number of levels for specific branches.

The extend of objects, i.e the initialization depth of CDM entities is documented in the ServiceDescriptions below. The extend is explained using a property path syntax which indicates the properties and transient getters of a specific CDM entity bean which are being initialized by the service.

  • Simple (name) - The specified name identifies an individual property of a particular CDM entity bean. The name of the actual getter method is determined using standard JavaBeans instrospection, so that a property named "xyz" will have a getter method named getXyz() or (for boolean properties only) isXyz(), and a setter method named setXyz().

  • Nested (name1.name2.name3) The first name element is used to select a property getter, as for simple references above. The object returned for this property is then consulted, using the same approach, for a property getter for a property named name2, and so on. The property value that is ultimately retrieved or modified is the one identified by the last name element.

  • Indexed (name[index]) - The underlying property value is assumed to be an array, or this JavaBean is assumed to have indexed property getter and setter methods. The appropriate (zero-relative) entry in the array is selected. List objects are now also supported for read/write. You simply need to define a getter that returns the List

  • *toOne-Wildcard ($) This wildcard is used to select all property getters which reference to one associated bean. A wildcard subsequently terminates a 'property path'.

  • toAny-Wildcard () This wildcard is used to select all property getters which reference to one associated bean and to to many associated bean. A wildcard subsequently terminates a 'property path'.

  • Combined (name1.name2[index].$) - Combining mapped, nested, and indexed and wildcard references is also supported.

~This syntax description partially is lend from Apache Commons BeanUtils ~

In fact the actual extend of serialized CDM entities may exceed the extend indicated by the property path syntax. This especially happens when a transient getter is to be initialized. Due to potential internal logic in the transient getter it is unpredictable which properties actually are being initialized when only looking at the property path. A common candidate for this is the getTaggedName() property of source:trunk/cdmlib/cdmlib-model/src/main/java/eu/etaxonomy/cdm/model/name/TaxonNameBase.java.

Developer Hints:

The initialization od CDM entities is performed by implementations of the source:trunk/cdmlib/cdmlib-persistence/src/main/java/eu/etaxonomy/cdm/persistence/dao/BeanInitializer.java Interface. In order to find out more on this topic please refer to CdmEntityInitalization.

Localization

I order to provide the client with localized resources all services respect the Accept-Language HTTP header #sec14.4.

For example the Portal service returns localized representations according to the Language tags supplied in the Accept-Language HTTP header.

The service tries finding the best matching representation. If no representation in any preferred language is found the service falls back to return the representation in source:trunk/cdmlib/cdmlib-model/src/main/java/eu/etaxonomy/cdm/model/common/Language.java#L126 and if necessary further falls back to return the first representation found if any exists.

Instances of the folowing CDM classes or subclasses of them potentially have multiple internationalized representations in different languages:

Localization is handeled a bit differently by various service sections the API Service just adds the localized representations. The Portal Service which focuses in representation, not only adds the localized representations but also hides the source:trunk/cdmlib/cdmlib-remote/src/main/java/eu/etaxonomy/cdm/model/common/Representation.java or source:trunk/cdmlib/cdmlib-remote/src/main/java/eu/etaxonomy/cdm/model/common/MultilanguageText.java fields from serialization in order to reduce complexity and to improve performance.

Developer Hints

Classes involved in Content Localization:

Configuration in:

Content Negotiation

There are two ways to demand a special content type:

  1. by file extension (*.json or *.xml)

  2. by Accept HTTP request header #sec14.1 - Accepted mime types are: application/json@, @text/xml

  3. Default: XML

The CDM REST Services 2.0 primarily trys using the file extension, then the Accept HTTP request header is taken into account. If whether the file extension or not the Accept HTTP request header specify valid content types the default XML will be used.

Developer Hints

Classes involved in Content Negotiation:

Configuration files involved:

Character Encoding

All data is returned in UTF-8 character encoding.

Service Descriptions

The syntax of the mapped service URIs contains the the {datasource-bean-name} path element. The available {datasource-bean-name}s are taken from a configuration file which is loaded by the CDM-Server during startup. The "datasources.xml" file is loaded by default from the following locations depending on the operation system in which the cdm-server is installed:

  • Linux: /opt/cdm-server/.cdmLibrary/datasources.xml

  • Windows: "%PROGRAMFILES%/EDIT CDM-Server/.cdmLibrary/datasources.xml"

The actual location of the datasources.xml" can specified and thus be overridden using a specific commandline parameter for EDIT CDM-Server. For more information please refer to the "EDIT CDM-Server documentation

_NOTE:

_

  1. _Former versions of the EDIT CDM-Server where using @ {USER_HOME}./cdmLibrary/datasources.xml@ this is now being only used by the EDIT Taxonomic Editor. _

  2. The UpdatableRoutingDataSource is no longer being used by the EDIT CDM-Server.

API Service

The are a clean RESTful webservice, which will expose data in a modular, normalized way.

It is a more-or-less one-to-one concordance between URIs and service api methods.

Due to its generic architecture the URIs are also generic and follow a common pattern which is repeated in each controller.

In the following the generic URIs are documented first followed by type specific implementations. The pathelement {base-type} is frequently used in generid URIs.

Valid Values for {base-type} are:

  • agent: Service URIs returning AgentBase or sub type entities.

  • description: Service URIs returning DescriptionBase or sub type entities.

  • feature: Service URIs returning DescriptionBase or sub type entities

  • media: Service URIs returning Media or sub type entities

  • name: Service URIs returning TaxonNameBase or sub type entities

  • occurrence: Service URIs returning SpecimenOrObservationBase or sub type entities

  • reference: Service URIs returning ReferenceBase or sub type entities

  • taxon: Service URIs returning TaxonBase or sub type entities

  • term: Service URIs returning DefinedTermBase or sub type entities

Most services are using the default initialisation strategy which is:

"$"

/{datasource-name}/{base-type}/

Depending on the URI parameters used, this service returns either a Pager on or a List of the {base-type} entities identified by the {uuid}.

The returned {base-type} instances are initialized by the default initialisation strategy.

URI Parameters to return a Pager:

  • pageNumber the number of the page to be returned, the first page has the pageNumber = 1 - optional parameter

  • pageSize the maximum number of entities returned per page (can be null to return all entities in a single page) - optional parameter

  • type Further restricts the type of entities to be returned. If null the type mapped by {base-type} is being used. - optional parameter

URI Parameters to return a List:

  • start The offset index from the start of the list. The first entity has the index = 0 - required parameter *The start parameter is used to distinguish between the List and Pager variants! *

  • limit The maximum number of entities returned. - optional parameter

  • type Further restricts the type of entities to return. If null the type mapped by {base-type} is being used. - optional parameter

/{datasource-name}/{base-type}/name/{uuid}

Get the {base-type} entity identified by the {uuid}.

Returns:

The returned {base-type} entity is initialized by the default initialisation strategy.

/{datasource-name}/{base-type}/name/{uuid}/annotation

Get the a Pager on the Annotations for the {base-type} entity identified by the {uuid}.

Returns:

Pager on the Annotations for the {base-type} entity identified by the {uuid}.

The returned {base-type} entity are initialized by the default initialisation strategy.


/{datasource-name}/name/{name-uuid}/typeDesignations

Get the list of TypeDesignationBases of the TaxonNameBase instance identified by the {name-uuid}.

Returns:

a List of TypeDesignationBase entities which are initialized using the following initialization strategy:

"$",
"citation.authorTeam",
"typifiedNames.taggedName"

/{datasource-name}/taxon/{taxon-uuid}/accepted

Get the set of accepted Taxon entities for a given {@link TaxonBase} entity identified by the {taxon-uuid}.

Returns:

a set of Taxon entities which are initialized using the default initialisation strategy..

Portal Service

/{datasource-name}/portal/name/{name-uuid}

The TaxonNameBase instance identified by the {name-uuid}.

The returned TaxonNameBase is initialized by the following strategy



/{datasource-name}/portal/name/{name-uuid}/descriptions

Get the list of TaxonNameDescriptions of the Name associated with the TaxonNameBase instance identified by the {name-uuid}.

Returns:

a List of TaxonNameDescription entities which are initialized using the following initialization strategy:

"uuid",
"feature",
"elements.$",
"elements.multilanguageText",
"elements.media.representations.parts"

/{datasource-name}/portal/name/{name-uuid}/typeDesignations

Get the list of TypeDesignationBases of the TaxonNameBase instance identified by the {name-uuid}.

Returns:

a List of TypeDesignationBase entities which are initialized using the following initialization strategy:

"citation.authorTeam",
"typeName.$",
"typeName.taggedName",
"typeStatus.representations",
"typeSpecimen.media.representations.parts"

/{datasource-name}/portal/taxon/{taxon-uuid}

Get the TaxonBase instance identified by the {taxon-uuid}.

The returned Taxon is initialized by the following strategy TAXON_INIT_STRATEGY

"*",
"relationsToThisName.fromTaxon.name.taggedName",
"name.$",
"name.taggedName",
"name.rank.representations",
"name.status.type.representations",
"descriptions.elements.$",
"descriptions.elements.area",
"descriptions.elements.area.$",
"descriptions.elements.multilanguageText",
"descriptions.elements.media.representations.parts",

/{datasource-name}/portal/taxon/find

Find Taxa, Synonyms, Common Names by name, either globally or in a specific geographic area.

URI Parameters:

  • query the string to query for. Since the wildcard character '*' internally always is appended to the query string, a search always compares the query string with the beginning of a name. - required parameter

  • treeUuid the UUID of a TaxonomicTree to which the search is to be restricted. - optional parameter

  • areas restrict the search to a set of geographic NamedAreas. The parameter currently takes a list of TDWG area labels. - optional parameter

  • page the number of the page to be returned, the first page has the pageNumber = 1 - optional parameter

  • pageSize the maximum number of entities returned per page (can be null to return all entities in a single page) - optional parameter

  • doTaxa weather to search for instances of Taxon - optional parameter

  • doSynonyms weather to search for instances of Synonym - optional parameter

  • doTaxaByCommonNames for instances of Taxon by a common name used - optional parameter

Returns:

a pager on a list of IdentifiableEntitys initialized by the following strategy:

"*",
"relationsToThisName.fromTaxon.name.taggedName",
"name.$",
"name.taggedName",
"name.rank.representations",
"name.status.type.representations"

/{datasource-name}/portal/taxon/{taxon-uuid}/synonymy

Get the synonymy for a taxon identified by the {taxon-uuid}. The synonymy consists of two parts: The group of homotypic synonyms of the taxon and the heterotypic synonymy groups of the taxon. The synonymy is ordered historically by the type designations and by the publication date of the nomenclatural reference

Returns:

a Map with to entries which are mapped by the following keys: "homotypicSynonymsByHomotypicGroup", "heterotypicSynonymyGroups", containing lists of Synonyms which are initialized using the following initialization strategy:

"synonymRelations.$",
"synonymRelations.synonym.$",
"synonymRelations.synonym.name.taggedName",
"synonymRelations.synonym.name.nomenclaturalReference.inBook.authorTeam",
"synonymRelations.synonym.name.nomenclaturalReference.inJournal",
"synonymRelations.synonym.name.nomenclaturalReference.inProceedings",
"synonymRelations.synonym.name.homotypicalGroup.typifiedNames.$",
"synonymRelations.synonym.name.homotypicalGroup.typifiedNames.name.taggedName",
"synonymRelations.synonym.name.homotypicalGroup.typifiedNames.taxonBases.$",
"synonymRelations.synonym.name.homotypicalGroup.typifiedNames.taxonBases.name.taggedName",

"name.homotypicalGroup.$",
"name.homotypicalGroup.typifiedNames.$",
"name.homotypicalGroup.typifiedNames.name.taggedName",

"name.homotypicalGroup.typifiedNames.taxonBases.$",
"name.homotypicalGroup.typifiedNames.taxonBases.name.taggedName"

/{datasource-name}/portal/taxon/{taxon-uuid}/accepted

Get the set of accepted Taxon entities for a given {@link TaxonBase} entity identified by the {taxon-uuid}.

Returns:

a Set of Taxon entities which are initialized using the following initialization strategy:

"synonymRelations.$",
"synonymRelations.synonym.$",
"synonymRelations.synonym.name.taggedName",
"synonymRelations.synonym.name.nomenclaturalReference.inBook.authorTeam",
"synonymRelations.synonym.name.nomenclaturalReference.inJournal",
"synonymRelations.synonym.name.nomenclaturalReference.inProceedings",
"synonymRelations.synonym.name.homotypicalGroup.typifiedNames.$",
"synonymRelations.synonym.name.homotypicalGroup.typifiedNames.name.taggedName",
"synonymRelations.synonym.name.homotypicalGroup.typifiedNames.taxonBases.$",
"synonymRelations.synonym.name.homotypicalGroup.typifiedNames.taxonBases.name.taggedName",

"name.homotypicalGroup.$",
"name.homotypicalGroup.typifiedNames.$",
"name.homotypicalGroup.typifiedNames.name.taggedName",

"name.homotypicalGroup.typifiedNames.taxonBases.$",
"name.homotypicalGroup.typifiedNames.taxonBases.name.taggedName"

/{datasource-name}/portal/taxon/{taxon-uuid}/taxonRelationships

Get the list of TaxonRelationships for the given TaxonBase instance identified by the {taxon-uuid}.

Returns:

a List of TaxonRelationship entities which are initialized using the following initialization strategy:

"$",
"type.inverseRepresentations",
"fromTaxon.sec.authorTeam",
"fromTaxon.name.taggedName"

/{datasource-name}/portal/taxon/{taxon-uuid}/nameRelationships

Get the list of NameRelationships of the Name associated with the TaxonBase instance identified by the {taxon-uuid}.

Returns:

a List of NameRelationship entities which are initialized using the following initialization strategy:

"$",
"type.inverseRepresentations",
"fromName.taggedName"

/{datasource-name}/portal/taxon/{taxon-uuid}/nameTypeDesignations

Get the list of TypeDesignationBases of the TaxonBase instance identified by the {taxon-uuid}.

Returns:

a List of TypeDesignationBase entities which are initialized using the following initialization strategy:

:

"typeSpecimen.$",
"typeStatus.representations",
"citation.authorTeam",
"typeName.taggedName"

/{datasource-name}/portal/taxon/{taxon-uuid}/descriptions

Get the list of TaxonDescriptions of the Taxon instance identified by the {taxon-uuid}.

Returns:

a List of TaxonDescription entities which are initialized using the following initialization strategy:

"$",
"elements.$",
"elements.citation.authorTeam",
"elements.multilanguageText",
"elements.media.representations.parts"

/{datasource-name}/portal/taxon/{taxon-uuid}/media/{mime type list}/{size}[,[widthOrDuration}][,{height}]/

Get the list of TaxonDescriptions of the Taxon instance identified by the {taxon-uuid}.

Usage:

/{datasource-name}/portal/taxon/{taxon-uuid}/media/{mime type list}/{size}[,[widthOrDuration}][,{height}]/

Whereas

  • {mime type list}: a comma separated list of mime types, in the order of preference. The forward slashes contained in the mime types must be replaced by a colon. Regular expressions can be used. Each media associated with this given taxon is being searched whereas the first matching mime type matching a representation always rules.

  • {size},{widthOrDuration},{height}: (not jet implemented) valid values are an integer or the asterisk '*' as a wildcard

Returns:

a List of Media entities which are initialized using the following initialization strategy:

"$",
"elements.$",
"elements.citation.authorTeam",
"elements.multilanguageText",
"elements.media.representations.parts"

/{datasource-name}/portal/taxontree

Lists all available TaxonomicTrees.

Returns:

A list of TaxonomicTrees initialized by the following initialization strategy:

"reference.authorTeam.titleCache"

/{datasource-name}/portal/taxontree/{tree-uuid},{rank-uuid}

Lists all TaxonNodes of the specified TaxonomicTree for a given Rank. If a branch does not contain a TaxonNode with a TaxonName at the given Rank the node associated with the next lower Rank is taken as root node. If the rank is null the absolute root nodes will be returned.

URI elements:

  • {tree-uuid} identifies the TaxonomicTree by its UUID.

  • {rank-uuid} identifies the Rank by its UUID. May be left out.

Returns:

A List of TaxonNode entities initialized by the following initialization strategy:

"taxon.sec", 
"taxon.name.taggedName"

/{datasource-name}/portal/taxontree/{tree-uuid},{rank- uuid}/{taxon-uuid}

Lists all child-TaxonNodes of the specified Taxon in the TaxonomicTree. The a given Rank is ignored in this method but for consistency reasons it has been allowed to included it into the URI.

URI elements:

  • {tree-uuid} identifies the TaxonomicTree by its UUID.

  • {rank-uuid} identifies the Rank by its UUID. May be left out.

  • {taxon-uuid} identifies the Taxon by its UUID. - required.

Returns:

A List of TaxonNode entities initialized by the following initialization strategy:

"taxon.sec", 
"taxon.name.taggedName"

/{datasource-name}/portal/taxontree/{tree-uuid},{rank-uuid}/{taxon-uuid}/path

Provides path of TaxonNodes from the base node to the node of the specified taxon.

URI elements:

  • {tree-uuid} identifies the TaxonomicTree by its UUID.

  • {rank-uuid} identifies the Rank by its UUID. May be left out.

  • {taxon-uuid} identifies the Taxon by its UUID. - required.

Returns:

A List of TaxonNode entities initialized by the following initialization strategy:

"taxon.sec", 
"taxon.name.taggedName"

External Service

/{datasource-name}/geo/map/distribution/{taxon-uuid}

Assembles and returns URI parameter Strings for the EDIT Map Service.

The distribution areas for the Taxon instance identified by the {taxon-uuid} are found and are translated into an valid URI parameter String.

Higher level distribiution areas are expanded in order to include all nested sub-areas.

Updated by Katja Luther almost 2 years ago · 65 revisions