Version 22 (modified by faber, 11 years ago) (diff)

Project updates

Table of Contents

  1. General Info
  2. ApiInfo
  3. Users
    1. Authentication
    2. Password Changes
    3. Profile Manipulation
    4. Notifications
    5. Creation and Deletion
    6. Manipulating Profile Attributes
  4. Projects
    1. Listing Projects
    2. Changing Project Membership
    3. Manipulating Projects
    4. Project Profiles
    5. Manipulating Profile Attributes
    6. Creating and Deleting Projects
  5. Circles
    1. Listing Circles
    2. Changing Circle Membership
    3. Manipulating Circles
    4. Circle Profiles
    5. Manipulating Profile Attributes
    6. Creating and Deleting Circles
  6. Experiments
    1. Viewing Experiments
    2. Creating and Deleting Experiments
    3. Realizing and Releasing Experiments
  7. Resources
    1. Computers
    2. Images
    3. Pubkey

DETER Testbed API

The DETER testbed API is broken up into 5 services, each covering one of the major abstractions that the testbed exports. The services are:

  • ApiInfo
  • Users
  • Projects
  • Resrources
  • Experiments

We discuss each in detail and provide links to the detailed javadoc of the implementation, where applicable and available.

The document and API are both works in progress and will be fleshed out and changed as the API is modified.

General Info

The API is implemented as a SOAP web service over TLS secured connections. The user's identity is generally provided by a client certificate, but the client certificates are generally transient. A valid temporary client certificate can be requested from the API by correctly responding to a challenge keyed on the user's password.

The API is implemented using the axis web service framework, which means that javadocs are provided for the various calls.

Each service and call are accessed by appending servicename/operation to the base URL of the API server. On DETERlab the base URL will be ​https://api.isi.deterlabnet:52323/axis2/service. For example, one can access the getVersion operation below at ​https://api.isi.deterlabnet:52323/axis2/service/ApiInfo/getVersion

Each operation returns useful parameters on success and throws a fault, called a DeterFault, on an error. Faults are standard SOAP faults with a detail section that includes the following fields:

  • ErrorCode - a 32-bit integer encoding the type of error. Constants are available in the ​the javadocs. Values are:
    • access - access denied
    • request - bad request
    • internal - internal server error
    • password - user has an expired password that must be changed
  • ErrorString - a string describing the broad error
  • DetailString - a string describing the details that caused the error

The ErrorString and ErrorCode are equivalent, but the information in the DetailString is generally more informative about the specifics. Request or access errors are generally correctable on the client side while internal errors are not.

​javadoc for DeterFault

ApiInfo

The ApiInfo service provides metadata about the running DETER API. It also provides a simple check that a user is presenting authentication credentials correctly.

​javadoc for ApiInfo

The primary operation in the ApiInfo service is getVersion. The call is unauthenticated and can be made driectly from a web browser to confirm that the API is functioning and that the user can see DETERlab.

  • Service: ApiInfo
  • Operation: getVersion
  • Input Parameters:
    • None
  • Return Values:
    • Version - A string containing the API version number
    • PatchLevel - A string containing the patch level
    • KeyID - A string. If the user presented a valid public key and passed the SSL challenge, this is the sha1 hash of that key. If no key was presented or an invalid one, this field is not returned.

There is an addtional simpler service, echo, that takes one parameter and returns it:

  • Service: ApiInfo
  • Operation: echo
  • Input Parameters:
    • param - a string to echo
  • Return Values:
    • the same string

Users

The Users API is concerned with managing users and their profiles as well as authenticating to the testbed and receiving a client certificate for later calls.

​javadoc for Users

Authentication

A user's identity is tied to an X.509 client certifcate issued by DETER. A certificate is bound to one user at a time, but a person can logout and log in as a different DETER user using the same certificate by presenting a different password, or logging out, which severs the connection of user to certificate.

A user can get a DETER-signed certificate by logging in without presenting an existing DETER-signed certificate. For example, the first time a user logs in, they will get a DETER-signed certificate.

A UI is welcome to keep one certificate for a session, or to reuse the certificates until they expire. The certificates are issued with several years of valid time.

A user can authenticate to the testbed and receive an X.509 certificate by requesting a challenge using the requestChallenge operation and responding to the challenge via the challengeResponse operation.

Currently only one challenge is available, type "clear". The challenge has no data and the user replies with their password in clear text. Note that the exchange is protected by the SSL encrypted exchange, but implementors should not respond to clear challenges with parameters in the query string. The "masked" challenge will address this issue shortly.

  • Service: Users
  • Operation: requestChallenge
  • Input Parameters:
    • userid - the identity to authenticate
    • types - a list of challenges that are acceptable to the user. May be empty
  • Return Values:
    • Type - the kind of challenge
    • Data - the data needed for the challenge
    • Validity - number of seconds the challenge may be responded to
    • ChallengeID - a 64-bit identifier that allows the server to validate the reply

Each challenge is valid for 2 minutes and are rate-limited. Web interfaces should collect the password from the user before requesting a challenge from the API to avoid spurious timeouts.

  • Service: Users
  • Operation: challengeResponse
  • Input Parameters:
    • ResponseData - a binary string, the response to the challenge
    • ChallengeID - The 64-bit identifier of the challenge being responded to
  • Return Values:
    • Certificate - an optional binary string containing a PEM-encoded X.509 certificate and private key. (Passed down the encrypted connection) If the user presented a certificate on this connection, no credential is returned.

Any certificate returned by the challenge is signed by the testbed.

The binding between user and certificate lasts 24 hours. It can be renewed by making another login exchange. A UI may want to prompt a user to login again before the binding times out.

  • Service: Users
  • Operation: logout
  • Input Parameters:
    • None
  • Return Values:
    • None

Removes the user-to-certificate binding for this certificate. The certificate can be reused or discarded, but cannot be used to manipulate the testbed without another successful requestChallenge/challengeResponse exchange.

Password Changes

The password is a unique user feature that is not in the profile because of its role in authentication. When a user needs to change their password there are two API calls that can be used.

If the user knows their current (or expired) password, they can authenticate using the standard challenge response protocol and then call

  • Service: Users
    • Operation: changePassword
    • Input Parameters:
      • uid - the userid to change (note that an admin may change others passwords)
      • newPass - the new passowrd
    • Return Values:
      • a boolean, true if successful, but errors will throw a fault

We expect that the web interface will handle issues like confirming user input to a password change page. The changePassword call just makes the change directly.

If a user has forgotten their password, the user can request a password challenge, sent to them at their profile e-mail address. The challenge is a 64-bit number that can be used to call changePasswordChallenge without logging in. To request a challenge, the web interface calls:

  • Service: Users
    • Operation: requestPasswordReset
    • Input Parameters:
      • uid - the userid to change
      • urlPrefix - a string prefixed to the challenge ID in the mail sent to the user
    • Return Values:
      • a boolean, true if successful, but most errors will throw a fault

Again, we expect this call to generally be made from a web interface that will then want to present an input form to the in order to reset their password. The urlPrefix field provides that hook. A web interface running on https://niftydeter.com might call requestPasswordReset with parameters 'forgetfuluser' and 'https://niftydeter.com/reset.html?challenge='. After that call forgetfuluser will get e-mail asking him or her to access the web page at https://niftydeter.com/reset.html?challenge=1283548127541824, allowing niftydeter.com to present their password change interface, and do error checking, etc. on the new password.

Each challenge is valid for 2 hours, and they are rate-limited so only a few can be outstanding.

With a valid challenge in hand, the web interface can call

  • Service: Users
    • Operation: changePasswordChallenge
    • Input Parameters:
      • challengeID - the 64-bit number from the e-mail
      • newPass - the new passowrd
    • Return Values:
      • a boolean, true if successful, but most errors will throw a fault

Profile Manipulation

DETER keeps metadata about each user called a profile. The API provides an authenticated user with several interfaces to query and modify their profile information.

In the API each element of profile data is represented as a structure with the following data in it:

  • name of the element
  • type of the element
    • string
    • integer
    • double
    • binary/opaque
  • value(s) of the element
  • a flag set if the element is optional
  • A flag set if the field can be removed from the profile
  • a modification type: elements may be read/write, read-only (e.g., username) or write-only (e.g., some shared secret) (valid strings are at ​the constants documentation.
  • a brief description of the field, intended to be presented by a web interface or other third party program
  • an ordering hint for web interfaces presenting the data to users, an integer
  • an optional length hint to give a web interface a hint as to how big an input field to present. 0 indicates no hint.

To get a profile schema, for example to create an empty web page,

  • Service: Users
  • Operation: getProfileDescription
  • Input Parameters:
  • Return Values:
    • Uid - always empty
    • A list of profile elements each containing
      • Name - a string, the element's name
      • DataType - a string giving the element's
        • string
        • integer
        • double
        • binary/opaque
      • Value - a string containing the element's value
      • Access - a string describing the access values (values at ​javadoc as described above)
      • Optional - a flag true if the field is optional (must be present but may be empty)
      • Removable - a flag true if the field can be removed
      • Description - a string explaining the field
      • Format - a regular expression that can be used to validate the field entry (may be null, and generally is for optional fields)
      • FormatDescription - A brief, natural language description of the field input constraints, e.g. "A valid e-mail address" or "only numbers and spaces".
      • OrderingHint - an integer suggesting where to present the attribute. Lower numbers come first
      • LengthHint - an integer suggesting how long an input firld should be presented

To read a user's profile (generally only users can read their own profile).

  • Service: Users
  • Operation: getUserProfile
  • Input Parameters:
    • userid - a string naming the user to be retrieved
  • Return Values:
    • Userid - the user whose profile is returned
    • A list of profile elements each containing
      • Name - a string, the element's name
      • DataType - a string giving the element's
        • string
        • integer
        • double
        • binary/opaque
      • Value - a string containing the element's value
      • Access - a string describing the access values (values at ​javadoc as described above)
      • Optional - a flag true if the field is optional (must be present but may be empty)
      • Removable - a flag true if the field can be removed
      • Description - a string explaining the field
      • Format - a regular expression that can be used to validate the field entry (may be null, and generally is for optional fields)
      • FormatDescription - A brief, natural language description of the field input constraints, e.g. "A valid e-mail address" or "only numbers and spaces".
      • OrderingHint - an integer suggesting where to present the attribute. Lower numbers come first
      • LengthHint - an integer suggesting how long an input field should be presented

Finally a user can modify a profile:

  • Service: Users
  • Operation: changeUserProfile
  • Input Parameters:
    • Userid - the user's profile to modify
    • A list of change requests. Each request contains
      • Name - the name of the field to change
      • Value - the new value of the field
      • Delete - a flag, if true delete the field rather than modify it
  • Return Values:
    • A list of responses each containing
      • Name - astring with the name of the field
      • Success - a flag indicating if the request succeeded
      • Reason - a string indicating the reason if Success is false

Notifications

A notification is a short message from another user or the testbed asking a user to take an action (add someone to a project, update a password before expiration) or communicating other information to the user (testbed downtime, etc). A web interface will want to present these to a user.

Each notification has a set of flags that define its state. Currently there are 2

  • READ true if the user has read the notification
  • URGENTtrue if the testbed considers this urgent information

The user is free to change this state using the markNotifications call. Note that notifications are per-user. A user who clears the READ or URGENT flag does not clear the flag for other recipients of the notification.

  • Service: Users
  • Operation: getNotifications
  • Input Parameters:
    • Userid - the user's identity to gather notifications
    • FirstDate - an optional date. If present only show notifications after that date
    • LastDate - an optional date. If present only show notifications before that date
    • Flags - A potentially empty list of flags to check. If a flag's name appears in this list, only notifications with their flag in the given state are returned.
      • Tag - a string, the name of the flag
      • isSet - a boolean, true if the flag should be set
  • Return Values:
    • A list of responses each containing
      • ID - a 64-bit integer identifying the notification
      • Flags - the notification state in the format
        • Tag - a string, the name of the flag
        • isSet - a boolean, true if notifications with the flag set should be returned, false if notifications with the flag unset should be returned
      • Sent - the date the notification was issued
      • Text - the text of the notification

The filtering variables are all applied if given.

The mask and flags variable define the state a user is searching for. If a bit is set in both mask and flags, only messages with that bit set are returned. Similarly if a bit is clear in flags and set in mask, only messages with that bit clear will be returned.

To be concrete: a user who wants to retrieve all unread messages (urgent or not) should send a flags field with the READ bit clear and a mask with the READ bit set. To retrieve only unread urgent messages, the flags should have READ clear and URGENT set, and both READ and URGENT set in the mask.

  • Service: Users
  • Operation: markNotifications
  • Input Parameters:
    • Userid - the user's identity to gather notifications
    • Ids - an array of 64-bit integers, the identifiers of the notifications to mark
    • Flags - A list of flags to modify. If a flag's name appears in this list, notifications will have their flag set to the given value.
      • Tag - a string, the name of the flag
      • isSet - a boolean, true if the flag should be set, false if it should be unset
  • Return Values:
    • None

Administrators can send notifications, for example to announce testbed events. The call to do so is:

  • Service: Users
  • Operation: sendNotification
  • Input Parameters:
    • Users - a list of uids to receive the notification
    • Projects - a list of projects to receive the notification. All users in the project will receive it
    • Flags - A list of initial flag values. If a flag's name appears in this list, notifications will have their flag set to the given value. Flags that do not appear will be unset.
      • Tag - a string, the name of the flag
      • isSet - a boolean, true if the flag should be set, false if it should be unset
    • Text - the content of the notification
  • Return Values:
    • None

Creation and Deletion

Finally a user can request access to the testbed by creating a profile. The user has no privileges and consumes minimal resources until they join a vetted project. This is an unauthenticated call, but the user profile is not created until an automated e-mail exchange is made between the testbed and the proto-user.

  • Service: Users
  • Operation: createUser
  • Input Parameters:
    • Userid - the requested userid (optional)
    • A list of profile elements each containing
      • Name - a string, the element's name
      • StringValue - a string containing the element's value
  • Return Values:
    • The userid actually created

Note that all non-optional fields must be provided, so this is best preceeded by a call to getProfileDescription to learn the fields.

A base userid is constructed, either from the userid presented or from a required field in the profile. If that base userid is available, that a user with that userid is created. Otherwise the userid is disambiguated until there are no collisions. The userid actually created is returned.

The user is created without membership in any projects and without a password. A password reset challenge (equivalent to one issued by requestPasswordReset) is issued and the challenge e-mailed to the user at the address in the profile.

Administrators can create users without the confirmation step:

  • Service: Users
  • Operation: createUserNoConfirm
  • Input Parameters:
    • Userid - the requested userid (optional)
    • A list of profile elements each containing
      • Name - a string, the element's name
      • StringValue - a string containing the element's value, unless it is binary/opaque
    • clearpassword - an optional string given the cleartext password
    • hash - an optional string containing a hashed password
    • hashtype - an optional string giving the type of hash
  • Return Values:
    • The userid actually created

Note that either the cleartext password or the hash and type must be passed. This interface is under for initializing the testbed or creating users in batch for something like a class.

Removing a user is accomplished using

  • Service: Users
  • Operation: removeUser
  • Input Parameters:
    • Userid - the requested userid
  • Return Values:
    • a boolean, true if the user was removed

Most users are unlikely to use this service, and policy may allow only administrators to remove users.

Manipulating Profile Attributes

Administrators may add attributes to user profiles or remove them. That is to say, add a schema (including format constraints and descriptions), not set a value for a user.

Creating an attribute:

  • Service: Users
    • Operation: createUserAttribute
    • Input Parameters:
      • Name - the attribute name
      • Type - the type (STRING, INT, FLOAT, OPAQUE)
      • Optional - a boolean, true if this attribute is optional
      • Access - a string: the user's ability to modify (READ_WRITE, READ_ONLY, WRITE_ONLY, NO_ACCESS)
      • Description - natural language description of the field (optional)
      • Format - a regular expression describing the format (optional)
      • Formatdescription - a natural language explanation of the format (optional)
      • OrderingHint - an integer suggesting where to present the attribute. Lower numbers come first
      • LengthHint - an integer suggesting how long an input
      • Def - default value of the attribute (will be set for all users)
    • Return Values:
      • a boolean, true if the attribute was created

And removing an attribute:

  • Service: Users
    • Operation: removeUserAttribute
    • Input Parameters:
      • Name - the attribute name
    • Return Values:
      • a boolean, true if the attribute was removed

Finally administrators can modify profile attributes:

  • Service: Users
    • Operation: modifyUserAttribute
    • Input Parameters:
      • Name - the attribute name
      • Type - the type (STRING, INT, FLOAT, OPAQUE)
      • Optional - a boolean, true if this attribute is optional
      • Access - a string: the user's ability to modify (READ_WRITE, READ_ONLY, WRITE_ONLY, NO_ACCESS)
      • Description - natural language description of the field (optional)
      • Format - a regular expression describing the format (optional)
      • Formatdescription - a natural language explanation of the format (optional)
      • OrderingHint - an integer suggesting where to present the attribute. Lower numbers come first
      • LengthHint - an integer suggesting how long an input
    • Return Values:
      • a boolean, true if the attribute was created

Projects

The profile API lets users manage their project memberships as well as manipulate projects.

Listing Projects

Authenticated users can look at the various projects they are members of, and may scope such searcher by project names.

  • Service: Projects
  • Operation: viewProjects
  • Input Parameters:
    • Userid - the requester's userid
    • Owner - a userid - only find projects owned by this user
    • NameRE - a string containing a regular expression to match against project names
  • Return Values:
    • A list of project descriptors containing
      • Name - a string contaiing the project name
      • Owner - the uid of the project owner
      • Members - an array of structures containing
        • Userid - a member's userid
        • Permissions - a list of strings encoding the user's rights (each a flag, if present the user has the right)
          • ADD_USER - right to add a user to this project
          • REMOVE_USER - right to remove a user from this project
          • CREATE_CIRCLE - the right to create a circle under this project's name space
      • Approved - a flag indicating this project has been approved

Filters are cumulative: specifying a regular expression and an owner will match on both.

Changing Project Membership

Each of these changes propagates to the linked circle that controls resource permissions for the project. In particular, the permissions fields should include the union of the project and circle rights to set

With appropriate rights a user can add another user to a project they are in. The user being added must confirm this addition (below). As a result of this call, users being added will be sent a notification including a challenge id to respond to, similar to a password change URL. The prefix for that URL can be passed in here.

  • Service: Projects
  • Operation: addUsers
  • Input Parameters:
    • ProjectID - the project
    • Uids - the userids to add
    • Perms - a list of strings giving the permissions to grant the user in this project. The values are the same as in viewProjects.
    • urlPrefix - a prefix to direct the user to a specific web interface to respond to the challenge.
  • Return Values:
    • A list of results of the form
      • Name - the uid being added
      • Success - a flag indicating success or failure
      • Reason - the reason for a failure

For each user successfully added, a notification is sent. To respond to that notification the UI must call:

  • Service: Projects
    • Operation: addUserConfirm
    • Input Parameters:
      • ChallengeID - the challenge being responded to
    • Return Values:
      • true if the user was added. A fault is thrown on errors.

Once the confirmation is received, the user is actually a member of the project. If challenges are not responded to in 48 hours, they are no longer valid.

Administrators can add users without going through the confirmation process:

  • Service: Projects
    • Operation: addUsersNoConfirm
    • Input Parameters:
      • ProjectID - the project
      • Uids - the userids to add
      • Perms - a list of strings that define the user's rights. They are the same strings as in viewProjects.
    • Return Values:
      • A list of results of the form
        • Name - the uid being added
        • Success - a flag indicating success or failure
        • Reason - the reason for a failure

Users can also request to join a project. This requires some member of the project with ADD_USER rights to agree, so a notification is sent to all such users.

  • Service: Projects
  • Operation: joinProject
  • Input Parameters:
    • Uid - the uid to add
    • ProjectID - the project to join
    • urlPrefix - a prefix to direct the user to a specific web interface to respond to the challenge.
  • Return Values:
    • None

The join succeeds when a user with appropriate permissions calls joinProjectConfirm. Note that the user calling joinProjectConfirm sets the new user's project permissions.

  • Service: Projects
    • Operation: joinProjectConfirm
    • Input Parameters:
      • ChallengeID - the challenge being responded to
      • Perms - a list of strings defining the permissions to grant the user in this project. The values are as in viewProjects.
    • Return Values:
      • true if the user was successfully added. A fault is thrown on errors.

Users can be removed from projects:

  • Service: Projects
  • Operation: removeUsers
  • Input Parameters:
    • ProjectName - the project to change
    • Uids - uids to remove
  • Return Values:
    • A list of results of the form
      • Name - the uid being added
      • Success - a flag indicating success or failure
      • Reason - the reason for a failure

If a user has the right to both add and remove a user, that user can change a user's permissions:

  • Service: Projects
  • Operation: changePermissions
  • Input Parameters:
    • ProjectName - the project to change
    • Uids - the uids to manipulate
    • Permissions - a list of strings encoding the user's rights (each a flag - the user is assigned the right/permission if the string is present). The values are as in viewProjects.
  • Return Values:
    • A list of results of the form
      • Name - the uid being added
      • Success - a flag indicating success or failure
      • Reason - the reason for a failure

Manipulating Projects

The owner of a group (and only the owner of that group) can give that privilege away:

  • Service: Projects
  • Operation: setOwner
  • Input Parameters:
    • Userid - the requester's userid
    • ProjectName - the project to change
    • NewOwner - the uid of the new owner
  • Return Values:
    • None

Project Profiles

The calls for manipulating a project profile are very similar to user profiles:

To get a profile schema, for example to create an empty web page,

  • Service: Projects
  • Operation: getProfileDescription
  • Input Parameters:
  • Return Values:
    • Projectid - always empty
    • A list of profile elements each containing
      • Name - a string, the element's name
      • DataType - a string giving the element's
        • string
        • integer
        • double
        • binary/opaque
      • Value - a string containing the element's value
      • Access - a string describing the access values (values ​here)
      • Optional - a flag true if the field is optional (must be present but may be empty)
      • Removable - a flag true if the field can be removed
      • Description - a string explaining the field
      • Format - a regular expression that can be used to validate the field entry (may be null, and generally is for optional fields)
      • FormatDescription - A brief, natural language description of the field input constraints, e.g. "A valid e-mail address" or "only numbers and spaces".
      • OrderingHint - an integer suggesting where to present the attribute. Lower numbers come first
      • LengthHint - an integer suggesting how long an input firld should be presented

To read a project's profile.

  • Service: Projects
  • Operation: getProjectProfile
  • Input Parameters:
    • userid - a string naming the user to be retrieved
  • Return Values:
    • Projectid - the user whose profile is returned
    • A list of profile elements each containing
      • Name - a string, the element's name
      • DataType - a string giving the element's
        • string
        • integer
        • double
        • binary/opaque
      • Value - a string containing the element's value
      • Access - a string describing the access values (Defined ​here)
      • Optional - a flag true if the field is optional (must be present but may be empty)
      • Removable - a flag true if the field can be removed
      • Description - a string explaining the field
      • Format - a regular expression that can be used to validate the field entry (may be null, and generally is for optional fields)
      • FormatDescription - A brief, natural language description of the field input constraints, e.g. "A valid e-mail address" or "only numbers and spaces".
      • OrderingHint - an integer suggesting where to present the attribute. Lower numbers come first
      • LengthHint - an integer suggesting how long an input field should be presented

Finally a user can modify a project profile:

  • Service: Projects
  • Operation: changeProjectProfile
  • Input Parameters:
    • ProjectId - the project's profile to modify
    • A list of change requests. Each request contains
      • Name - the name of the field to change
      • Value - the new value of the field
      • Delete - a flag, if true delete the field rather than modify it
  • Return Values:
    • A list of responses each containing
      • Name - astring with the name of the field
      • Success - a flag indicating if the request succeeded
      • Reason - a string indicating the reason if Success is false

Manipulating Profile Attributes

Administrators may add attributes to project profiles or remove them. That is to say, add a schema (including format constraints and descriptions), not set a value for a project.

Creating an attribute:

  • Service: Projects
    • Operation: createProjectAttribute
    • Input Parameters:
      • Name - the attribute name
      • Type - the type (STRING, INT, FLOAT, OPAQUE)
      • Optional - a boolean, true if this attribute is optional
      • Access - a string: the user's ability to modify (READ_WRITE, READ_ONLY, WRITE_ONLY, NO_ACCESS)
      • Description - natural language description of the field (optional)
      • Format - a regular expression describing the format (optional)
      • Formatdescription - a natural language explanation of the format (optional)
      • OrderingHint - an integer suggesting where to present the attribute. Lower numbers come first
      • LengthHint - an integer suggesting how long an input
      • Def - default value of the attribute (will be set for all users)
    • Return Values:
      • a boolean, true if the attribute was created

And removing an attribute:

  • Service: Projects
    • Operation: removeProjectAttribute
    • Input Parameters:
      • Name - the attribute name
    • Return Values:
      • a boolean, true if the attribute was removed

Finally administrators can modify profile attributes:

  • Service: Projects
    • Operation: modifyProjectAttribute
    • Input Parameters:
      • Name - the attribute name
      • Type - the type (STRING, INT, FLOAT, OPAQUE)
      • Optional - a boolean, true if this attribute is optional
      • Access - a string: the user's ability to modify (READ_WRITE, READ_ONLY, WRITE_ONLY, NO_ACCESS)
      • Description - natural language description of the field (optional)
      • Format - a regular expression describing the format (optional)
      • Formatdescription - a natural language explanation of the format (optional)
      • OrderingHint - an integer suggesting where to present the attribute. Lower numbers come first
      • LengthHint - an integer suggesting how long an input
    • Return Values:
      • a boolean, true if the attribute was created

Creating and Deleting Projects

Creating and removing projects are also similar to creating and removing users:

  • Service: Projects
  • Operation: createProject
  • Input Parameters:
    • ProjectId - the new project's name
    • Owner - the new owner's uid (usually the caller)
    • profile - a list of attributes that will make up the project's profile
    • A list of profile elements each containing
      • Name - a string, the element's name
      • StringValue - a string containing the element's value
  • Return Values:
    • None

As with users, all required (non-optional) fields in the profile must be provided. The project will be created, but have no rights until approved.

On success the new project is created with the calling user as owner and sole member. The user has all rights.

Approval is a result of the testbed's vetting process. The user will be sent a notification when their project is approved. When approved this call is made by an admin.

  • Service: Projects
  • Operation: approveProject
  • Input Parameters:
    • ProjectID - the project's name
    • approved - a boolean, the new approval state
  • Return Values:
    • None

Note that this call can be used to un-approve a previously approved project.

Removing a project is straightforward

  • Service: Projects
  • Operation: removeProject
  • Input Parameters:
    • ProjectId - the requester's userid
  • Return Values:
    • None

Generally an removing a project requires a testbed administrator.

Circles

The profile API lets users manage their circle memberships as well as manipulate circles. The circles API is similar to the Projects API. The primary exceptions are that there is no approval process for circles (though there is for joining or adding a user) and that the permissions are different.

These calls work on all circles except those linked to a project. Those circles must have their membership, ownership, and permissions manipulated through the project to ensure that the contents remain synchronized.

Listing Circles

Authenticated users can look at the various circles they are members of, and may scope such searcher by circle names.

  • Service: Circles
  • Operation: viewCircles
  • Input Parameters:
    • Userid - the requester's userid
    • Owner - a userid - only find circles owned by this user
    • NameRE - a string containing a regular expression to match against circle names
  • Return Values:
    • A list of circle descriptors containing
      • Name - a string contaiing the circle name
      • Owner - the uid of the circle owner
      • Members - an array of structures containing
        • Userid - a member's userid
        • rights - a 32-bit integer encoding the user's rights (each a flag)
          • ADD_USER - right to add a user to this circle
          • REMOVE_USER - right to remove a user from this circle
          • REALIZE_EXPERIMENT - the right to realize an experiment under this circle

Filters are cumulative: specifying a regular expression and an owner will match on both.

Changing Circle Membership

With appropriate rights a user can add another user to a circle they are in. The user being added must confirm this addition (below). As a result of this call, users being added will be sent a notification including a challenge id to respond to, similar to a password change URL. The prefix for that URL can be passed in here.

  • Service: Circles
  • Operation: addUsers
  • Input Parameters:
    • CircleID - the circle
    • Uids - the userids to add
    • Perms - the permissions to grant the user in this circle. The values are given here.
    • urlPrefix - a prefix to direct the user to a specific web interface to respond to the challenge.
  • Return Values:
    • A list of results of the form
      • Name - the uid being added
      • Success - a flag indicating success or failure
      • Reason - the reason for a failure

For each user successfully added, a notification is sent. To respond to that notification the UI must call:

  • Service: Circles
    • Operation: addUserConfirm
    • Input Parameters:
      • ChallengeID - the challenge being responded to
    • Return Values:
      • true if the user was added. A fault is thrown on errors.

Administrators can add users without going through the confirmation process:

  • Service: Circles
    • Operation: addUsersNoConfirm
    • Input Parameters:
      • CircleID - the circle
      • Uids - the userids to add
      • Perms - the permissions to grant the user in this circle. The values are given here.
    • Return Values:
      • A list of results of the form
        • Name - the uid being added
        • Success - a flag indicating success or failure
        • Reason - the reason for a failure

Users can also request to join a circle. This requires some member of the circle with ADD_USER rights to agree, so a notification is sent to all such users.

  • Service: Circles
  • Operation: joinCircle
  • Input Parameters:
    • Uid - the uid to add
    • CircleID - the circle to join
    • urlPrefix - a prefix to direct the user to a specific web interface to respond to the challenge.
  • Return Values:
    • None

The join succeeds when a user with appropriate permissions calls joinCircleConfirm. Note that the user calling joinCircleConfirm sets the new user's circle permissions.

  • Service: Circles
    • Operation: joinCircleConfirm
    • Input Parameters:
      • ChallengeID - the challenge being responded to
      • Perms - the permissions to grant the user in this circle. The values are given here.
    • Return Values:
      • true if the user was subsequently added. A fault is thrown on errors.

Users can be removed from circles:

  • Service: Circles
  • Operation: removeUsers
  • Input Parameters:
    • CircleName - the circle to change
    • Uids - uids to remove
  • Return Values:
    • A list of results of the form
      • Name - the uid being added
      • Success - a flag indicating success or failure
      • Reason - the reason for a failure

If a user has the right to both add and remove a user, that user can change a user's permissions:

  • Service: Circles
  • Operation: changePermissions
  • Input Parameters:
    • CircleName - the circle to change
    • Uids - the uids to manipulate
    • Rights - a 32-bit integer encoding the user's rights (each a flag)
  • Return Values:
    • A list of results of the form
      • Name - the uid being added
      • Success - a flag indicating success or failure
      • Reason - the reason for a failure

Manipulating Circles

The owner of a group (and only the owner of that group) can give that privilege away to another member:

  • Service: Circles
  • Operation: setOwner
  • Input Parameters:
    • Userid - the requester's userid
    • CircleName - the circle to change
    • NewOwner - the uid of the new owner
  • Return Values:
    • None

Circle Profiles

The calls for manipulating a circle profile are very similar to user profiles:

To get a profile schema, for example to create an empty web page,

  • Service: Circles
  • Operation: getProfileDescription
  • Input Parameters:
  • Return Values:
    • Circleid - always empty
    • A list of profile elements each containing
      • Name - a string, the element's name
      • DataType - a string giving the element's
        • string
        • integer
        • double
        • binary/opaque
      • Value - a string containing the element's value
      • Access - a 32-bit integer describing the access values (values at ​Attribute's javadoc)
        • READ_WRITE
        • READ_ONLY
        • WRITE_ONLY (e.g., password)
      • Optional - a flag true if the field is optional (must be present but may be empty)
      • Removable - a flag true if the field can be removed
      • Description - a string explaining the field
      • Format - a regular expression that can be used to validate the field entry (may be null, and generally is for optional fields)
      • FormatDescription - A brief, natural language description of the field input constraints, e.g. "A valid e-mail address" or "only numbers and spaces".
      • OrderingHint - an integer suggesting where to present the attribute. Lower numbers come first
      • LengthHint - an integer suggesting how long an input firld should be presented

To read a circle's profile.

  • Service: Circles
  • Operation: getCircleProfile
  • Input Parameters:
    • userid - a string naming the user to be retrieved
  • Return Values:
    • Circleid - the user whose profile is returned
    • A list of profile elements each containing
      • Name - a string, the element's name
      • DataType - a string giving the element's
        • string
        • integer
        • double
        • binary/opaque
      • Value - a string containing the element's value
      • Access - a 32-bit integer describing the access values (values at ​Attribute's javadoc)
        • READ_WRITE
        • READ_ONLY
        • WRITE_ONLY (e.g., password)
      • Optional - a flag true if the field is optional (must be present but may be empty)
      • Removable - a flag true if the field can be removed
      • Description - a string explaining the field
      • Format - a regular expression that can be used to validate the field entry (may be null, and generally is for optional fields)
      • FormatDescription - A brief, natural language description of the field input constraints, e.g. "A valid e-mail address" or "only numbers and spaces".
      • OrderingHint - an integer suggesting where to present the attribute. Lower numbers come first
      • LengthHint - an integer suggesting how long an input field should be presented

Finally a user can modify a circle profile:

  • Service: Circles
  • Operation: changeCircleProfile
  • Input Parameters:
    • CircleId - the circle's profile to modify
    • A list of change requests. Each request contains
      • Name - the name of the field to change
      • Value - the new value of the field
      • Delete - a flag, if true delete the field rather than modify it
  • Return Values:
    • A list of responses each containing
      • Name - astring with the name of the field
      • Success - a flag indicating if the request succeeded
      • Reason - a string indicating the reason if Success is false

Manipulating Profile Attributes

Administrators may add attributes to circle profiles or remove them. That is to say, add a schema (including format constraints and descriptions), not set a value for a circle. Creating an attribute:

  • Service: Circles
    • Operation: createCircleAttribute
    • Input Parameters:
      • Name - the attribute name
      • Type - the type (STRING, INT, FLOAT, OPAQUE)
      • Optional - a boolean, true if this attribute is optional
      • Access - an integer the user's ability to modify (READ_WRITE, READ_ONLY, WRITE_ONLY, NO_ACCESS)
      • Description - natural language description of the field (optional)
      • Format - a regular expression describing the format (optional)
      • Formatdescription - a natural language explanation of the format (optional)
      • OrderingHint - an integer suggesting where to present the attribute. Lower numbers come first
      • LengthHint - an integer suggesting how long an input
      • Def - default value of the attribute (will be set for all users)
    • Return Values:
      • a boolean, true if the attribute was created

And removing an attribute:

  • Service: Circles
    • Operation: removeCircleAttribute
    • Input Parameters:
      • Name - the attribute name
    • Return Values:
      • a boolean, true if the attribute was removed

Finally administrators can modify profile attributes:

  • Service: Circles
    • Operation: modifyCircleAttribute
    • Input Parameters:
      • Name - the attribute name
      • Type - the type (STRING, INT, FLOAT, OPAQUE)
      • Optional - a boolean, true if this attribute is optional
      • Access - an integer the user's ability to modify (READ_WRITE, READ_ONLY, WRITE_ONLY, NO_ACCESS)
      • Description - natural language description of the field (optional)
      • Format - a regular expression describing the format (optional)
      • Formatdescription - a natural language explanation of the format (optional)
      • OrderingHint - an integer suggesting where to present the attribute. Lower numbers come first
      • LengthHint - an integer suggesting how long an input
    • Return Values:
      • a boolean, true if the attribute was created

Creating and Deleting Circles

Creating and removing circles are also similar to creating and removing users:

  • Service: Circles
  • Operation: createCircle
  • Input Parameters:
    • CircleId - the new circle's name
    • Uid - the new owner's uid (usually the caller)
    • profile - a list of attributes that will make up the circle's profile
    • A list of profile elements each containing
      • Name - a string, the element's name
      • StringValue - a string containing the element's value
  • Return Values:
    • None

As with users, all required (non-optional) fields in the profile must be provided. The circle will be created, and can be used immediately.

Removing a circle is straightforward.

  • Service: Circles
  • Operation: removeCircle
  • Input Parameters:
    • Userid - the requester's userid
    • Name - the new circle's name
  • Return Values:
    • None

Experiments

The experiment interface controls managing experiment definitions and realizing experimnets (allocating and initializing resources). The experimnet definition is in some flux, which is reflected in this section.

Viewing Experiments

One or more experiments can be viewed by an authorized user assuming that user has the proper permissions. The creator of a project owns it and that userid scopes its name. That is an experiment's name is a pair: (owner, name). This allows experiments to be instantiated in different projects.

  • Service: Experiments
  • Operation: viewExperiments
  • Input Parameters:
    • Userid - the user making the request
    • ExperimentRE - a string containing a regular expression matched against project names (may be omitted)
    • Owner - a string holding the owner of experiments to find (may be omitted)
    • Components - a 32-bit integer containing a mask of fields to include
      • EXPERIMENT_TOPOLOGY - include the topology
      • EXPERIMENT_ACTIONS - include the actions
      • EXPERIMENT_CONSTRAINTS - include constraints
      • EXPERIMENT_DATACOLLECTION - include data collection
      • EXPERIMENT_RESOURCES - include resources needed or allocated
      • EXPERIMENT_CONTAINERS - include components if realized
      • EXPERIMENT_LOG - include realization log and fault
      • EXPERIMENT_PERMISSIONS - include project permissions
    • TopologyFormat - an optional 32-bit int naming the topology format
      • TOPOLOGY_TOPDL - return a topdl file
      • TOPOLOGY_NS2 - return an ns2 file
    • TopologyFilter - an optional filter for limiting scope of the topology file format TBD
    • ActionFormat - an optional 32-bit int naming the action file format (values TBD)
    • ActionFilter - an optional filter for limiting scope of the constraint file format TBD
    • ConstraintFormat - an optional 32-bit int naming the constraint format (values TBD)
    • ConstraintFilter - an optional filter for limiting scope of the constraint file format TBD
    • DataCollectionFormat - an optional 32-bit int naming the data collection format (values TBD)
    • DataCollectionFilter - an optional filter for limiting scope of the data collection file format TBD
    • ResourceFilter - an optional filter for limiting scope of the resouces returned format TBD
    • ContainerFilter - an optional filter for limiting scope of the constainers returned format TBD
  • Return Values:
    • One or more structures with the following fields
      • Name - a string containing the experiment name
      • Owner - a string containing the owner's userid
      • Project - an optional string. If present the experiment is realized under this project
      • Topology - an optional file describing the experiment topology subject to filters and format constraints
      • Actions - an optional file describing the experiment actions subject to filters and format constraints
      • Constraints - an optional file describing the experiment constraints subject to filters and format constraints
      • DataCollection - an optional file describing the experiment data collection subject to filters and format constraints
      • Containers - an optional list with the following fields describing the containers in the experimnet, if it is realized. Subject to filtering.
        • Name - the container name
        • State - a string indicating state (Up, Down, Configured, Pinned, None)
        • Type - a string indicating the container type
      • Resources - an optional list of structures giving resources needed by or allocated to the experiment, subject to filtering.
        • Name - resource name
        • Type - resource type
      • State - a string, one of
        • "Unrealized", "Realized", "Changing", "Pinned" (Pinned means that some modification other than realization is underway)
      • StateDetail - a string giving additional state information. values TBD
      • Log - an optional file containing messages from the last realization attempt for debugging
      • FaultInfo - an optional structure containing the high level error message (if any) from the last realization. It contains the error fields from a DeterFault:
        • ErrorCode - a 32-bit integer encoding the type of error. Constants are available in the ​javadoc for DeterFault. Values are:
          • access - access denied
          • request - bad request
          • internal - internal server error
        • ErrorString - a string describing the broad error
        • DetailString - a string describing the details that caused the error
      • ReadProjects - a list of project names allowed to read this experiment
      • WriteProjects - a list of project names allowed to modify this experiment
      • RealizeProjects - a list of project names allowed to realize this experiment

Creating and Deleting Experiments

An experiment is created using:

  • Service: Experiments
  • Operation: createExperiment
  • Input Parameters:
    • Userid - the user making the request (the owner on success)
    • Name - a string containing a new experiment's name
    • Topology - an optional file describing the experiment topology
    • Actions - an optional file describing the experiment actions
    • Constraints - an optional file describing the experiment constraints s
    • DataCollection - an optional file describing the experiment data collection
    • ReadProjects - a list of project names allowed to read this experiment
    • WriteProjects - a list of project names allowed to modify this experiment
    • RealizeProjects - a list of project names allowed to realize this experiment
  • Return Values:
    • None

An experiment is modified using:

  • Service: Experiments
  • Operation: modifyExperiment
  • Input Parameters:
    • Userid - the user making the request (the owner on success)
    • Owner - the experiment owner
    • Name - a string containing the experiment's name
    • Topology - an optional file describing the experiment topology
    • Actions - an optional file describing the experiment actions
    • Constraints - an optional file describing the experiment constraints s
    • DataCollection - an optional file describing the experiment data collection
    • ReadProjects - a list of project names allowed to read this experiment
    • WriteProjects - a list of project names allowed to modify this experiment
    • RealizeProjects - a list of project names allowed to realize this experiment
  • Return Values:
    • None

Omitted arguments are not overwritten. To delete a field supply an empty description.

There will also be filter-based modification interfaces, but these are TBD.

An experiment is deleted using:

  • Service: Experiments
  • Operation: removeExperiment
  • Input Parameters:
    • Userid - the user making the request (the owner on success)
    • Owner - the experiment owner
    • Name - a string containing the experiment to delete
  • Return Values:
    • None

After removeExperiment succeeds, experiment state is removed from the testbed completely.

Realizing and Releasing Experiments

To realize an experiment use:

  • Service: Experiments
  • Operation: realizeExperiment
  • Input Parameters:
    • Userid - the user making the request (the owner on success)
    • Owner - the experiment owner
    • Name - a string containing the experiment to realize
    • Notify - a flag, if true send the user a notification when realization is complete
  • Return Values:
    • None

The user can either poll the experiment using viewExperiments and examining the StateDetail field or poll for a notification that the realization is complete.

If the realization fails - as indicated by the State variable in a viewExperiments response, the Log and FaultInfo fields characterize the error.

To release an experiment's resources:

  • Service: Experiments
  • Operation: releaseExperiment
  • Input Parameters:
    • Userid - the user making the request (the owner on success)
    • Owner - the experiment owner
    • Name - a string containing the experiment to release
    • Notify - a flag, if true send the user a notification when realization is complete
  • Return Values:
    • None

After releaseExperiment succeeds, experiment state remains in the testbed, but containers are stopped and resources are returned to the testbed.

Resources

Resources are things that make up experiments. There are several specialized resources used in experimentation that have their own suite of operations, and there is a general set of operations for future expansion.

Computers

Computers are the physical computing resources of the testbed. A user may be interested in specific instances of a computer - pc23 - or in information about types or classes of computers. Both are possible to view with these calls.

A user can view computers or classes by:

  • Service: Resources
  • Operation: viewComputers
  • Input Parameters:
    • Userid - the user making the request (the owner on success)
    • Owner - an optional string the computer owner
    • NameRE - an optional string containing a regular expression matched against the name
    • Type - an optional string containing the computer types to look for
  • Return Values:
    • Zero or more structures with the following fields:
      • Name - a string, the name of this computer, if absent this is a class
      • Owner - a string, the owner of the computer or class
      • Type - a string containing the type of computer
      • Description - a string describing this computer or class
      • Allocated - an optional flag indicating whether this computer is allocated. The field is absent all together if this structure describes a class
      • AllocatedExperiment - an optional string containing the experiment name if the computer is allocated and the user has the right to read the experiment
      • AllocatedProject - an optional string containing the project name in which the experiment is realized if the computer is allocated and the user has the right to read the project
      • ProjectDelete - an optional list of project names that can delete this resource
      • ProjectModify - an optional list of project names that can modify this resource
      • ProjectUse - an optional list of project names that can use this resource
      • ProjectRead - an optional list of projects names that can read this resource

If any of the permission fields are not present, the class permissions apply. If they are present for a specific computer, they specific computer's permissions override the class permissions.

Administrators can add new computers or classes using

  • Service: Resources
  • Operation: createComputer
  • Input Parameters:
    • Userid - the user making the request (the owner on success)
    • Name - an optional string, the name of this computer, if absent this is a class
    • Type - a string containing the type of computer
    • Description - an optional string describing this computer or class (If omitted for a computer, the type description is used)
    • ProjectDelete - an optional list of project names that can delete this resource
    • ProjectModify - an optional list of project names that can modify this resource
    • ProjectUse - an optional list of project names that can use this resource
    • ProjectRead - an optional list of projects names that can read this resource
  • Return Values: None

Note that missing fields in a computer creation are generally filled in from the type. Creating a computer or class without any projects that can use it is of questionable value.

Similarly, they can modify an existing computer using (assuming they are in a project that allows modification of the class or computer):

  • Service: Resources
  • Operation: modifyComputer
  • Input Parameters:
    • Userid - the user making the request
    • Name - an optional string, the name of this computer, if absent this is a class
    • Type - an optional string containing the type of computer
    • Description - an optional string describing this computer or class (If omitted for a computer, the type description is used)
    • ProjectDelete - an optional list of project names that can delete this resource
    • ProjectModify - an optional list of project names that can modify this resource
    • ProjectUse - an optional list of project names that can use this resource
    • ProjectRead - an optional list of projects names that can read this resource
  • Return Values: None

Values passed in overwrite the current values if the user had modify rights. One of Name or Type must be present.

Finally an administrator can delete a computer:

  • Service: Resources
  • Operation: removeComputer
  • Input Parameters:
    • Userid - the user making the request
    • Name - an optional string, the name of this computer, if absent this is a class
    • Type - an optional string, the type of computer. May be omitted for specific computers
  • Return Values: None

Images

Images are saved container state - including saved physical container state. These are selected in the experiment definition, but users may need to manipulate them directly.

To read image information:

  • Service: Resources
  • Operation: viewImages
  • Input Parameters:
    • Userid - the user making the request (the owner on success)
    • Owner - an optional string the computer owner
    • NameRE - an optional string containing a regular expression matched against the name
  • Return Values:
    • Zero or more structures with the following fields:
      • Name - a string, the name of this image
      • Owner - a string, the owner of the image
      • Description - a string describing this image
      • ValidIn - a list of container types that can use this image
      • ProjectDelete - a list of project names that can delete this resource
      • ProjectModify - a list of project names that can modify this resource
      • ProjectUse - a list of project names that can use this resource
      • ProjectRead - a list of projects names that can read this resource

Images are created by operations on a container, but users can modify or delete their metadata:

  • Service: Resources
  • Operation: modifyImage
  • Input Parameters:
    • Userid - the user making the request
    • Name - a string, the name of this image
    • Description - an optional string describing this computer or class
    • ValidIn - an optional list of container types that can use this image
    • ProjectDelete - an optional list of project names that can delete this resource
    • ProjectModify - an optional list of project names that can modify this resource
    • ProjectUse - an optional list of project names that can use this resource
    • ProjectRead - an optional list of projects names that can read this resource
  • Return Values: None

As with other resources, these values overwrite the existing parameters (except for name which is a selector).

A user can delete an image:

  • Service: Resources
  • Operation: removeImage
  • Input Parameters:
    • Userid - the user making the request (the owner on success)
    • Name - a string, the image to remove
  • Return Values: None

Pubkey

Public/Private keypairs are used several places in the testbed for authentication and access. For example, access to containers that present a computer interface is done using the ssh protocol. These interfaces allow users to manipulate their keys.

Viewing keys:

  • Service: Resources
    • Operation: viewKeys
    • Input Parameters:
      • Userid - the user making the request
      • Owner - an optional string the computer owner
      • type - an optional string containing the kind of keys to report
    • Return Values:
      • Zero or more structures with the following fields:
        • Name - a string, the name of this key
        • Owner - a string, the owner of the key
        • Description - a string describing this key
        • KeyData - an opaque data value - the key data
        • ProjectDelete - a list of project names that can delete this resource
        • ProjectModify - a list of project names that can modify this resource
        • ProjectUse - a list of project names that can use this resource
        • ProjectRead - a list of projects names that can read this resource

Users can add and delete keys:

  • Service: Resources
    • Operation: addKey
    • Input Parameters:
      • Userid - the user making the request (the owner on success)
      • Owner - an optional string the computer owner
      • Name - an optional string, the name of this key (system will assign if omitted)
      • Description - an optional string describing this key
      • KeyData - an opaque data value - the key data
      • ProjectDelete - a list of project names that can delete this resource
      • ProjectModify - a list of project names that can modify this resource
      • ProjectUse - a list of project names that can use this resource
      • ProjectRead - a list of projects names that can read this resource
    • Return Values:
      • None
  • Service: Resources
  • Operation: removeKey
  • Input Parameters:
    • Userid - the user making the request
    • Name - a string, the name of this key