mithril-vndb/docs/request.md
Barney Carroll af49a7dcb4 Long-term Node fans might take exception (lol)...
...to saying there aren't *any* mechanisms for error-handling in callback-centric async APIs
2016-06-21 10:09:59 +01:00

15 KiB

request(options)


API

stream = m.request(options)

Argument Type Required Description
options.method String Yes The HTTP method to use. This value should be one of the following: GET, POST, PUT, PATCH, DELETE, HEAD or OPTIONS.
options.url String Yes The URL to send the request to. The URL may be either absolute or relative, and it may contain interpolations.
options.data any No The data to be interpolated into the URL and serialized into the querystring (for GET requests) or body (for other types of requests).
options.async Boolean No Whether the request should be asynchronous. Defaults to true.
options.user String No A username for HTTP authorization. Defaults to undefined.
options.password String No A password for HTTP authorization. Defaults to undefined. This option is provided for XMLHttpRequest compatibility, but you should avoid using it because it sends the password in plain text over the network.
options.config xhr = Function(xhr) No Exposes the underlying XMLHttpRequest object for low-level configuration. Defaults to the identity function.
options.type any = Function(any) No A constructor to be applied to each object in the response. Defaults to the identity function.
options.serialize string = Function(any) No A serialization method to be applied to data. Defaults to JSON.stringify.
options.deserialize any = Function(string) No A deserialization method to be applied to the response. Defaults to a small wrapper around JSON.parse that returns null for empty responses.
options.extract string = Function(xhr, options) No A hook to specify how the XMLHttpRequest response should be read. Useful for reading response headers and cookies. Defaults to a function that returns xhr.responseText
options.useBody Boolean No Force the use of the HTTP body section for data in GET requests when set to true, or the use of querystring for other HTTP methods when set to false. Defaults to false for GET requests and true for other methods.
returns Stream A stream that resolves to the response data, after it has been piped through the extract, deserialize and type methods

How to read signatures


How it works

The m.request utility is a thin wrapper around XMLHttpRequest, and allows making HTTP requests to remote servers in order to save and/or retrieve data from a database.

m.request({
	method: "GET",
	url: "/api/v1/users",
}).map(function(users) {
	console.log(users)
})

Calls to m.request return a stream.

Dynamic URLs

Request URLs may contain interpolations:

m.request({
	method: "GET",
	url: "/api/v1/users/:id",
	data: {id: 123},
}).map(function(user) {
	console.log(user.id) // logs 123
})

In the code above, :id is populated with the data from the {id: 123} object, and the request becomes GET /api/v1/users/123.

Interpolations are ignored if no matching data exists in the data property.

m.request({
	method: "GET",
	url: "/api/v1/users/foo:bar",
	data: {id: 123},
})

In the code above, the request becomes GET /api/v1/users/foo:bar


Why JSON instead of HTML

Many server-side frameworks provide a view engine that interpolates database data into a template before serving HTML (on page load or via AJAX) and then employ jQuery to handle user interactions.

By contrast, Mithril is framework designed for thick client applications, which typically download templates and data separately and combine them in the browser via Javascript. Doing the templating heavy-lifting in the browser can bring benefits like reducing operational costs by freeing server resources. Separating templates from data also allow template code to be cached more effectively and enables better code reusability across different types of clients (e.g. desktop, mobile). Another benefit is that Mithril enables a retained mode UI development paradigm, which greatly simplifies development and maintenance of complex user interactions.

By default, m.request expects response data to be in JSON format. In a typical Mithril application, that JSON data is then usually consumed by a view.

You should avoid trying to render server-generated dynamic HTML with Mithril. If you have an existing application that does use a server-side templating system, and you wish to re-architecture it, first decide whether the effort is feasible at all to begin with. Migrating from a thick server architecture to a thick client architecture is typically a somewhat large effort, and involves refactoring logic out of templates into logical data services (and the testing that goes with it).

Data services may be organized in many different ways depending on the nature of the application. RESTful architectures are popular with API providers, and service oriented architectures are often required where there are lots of highly transactional workflows.


Why XMLHttpRequest instead of fetch

fetch() is a newer Web API for fetching resources from servers, similar to XMLHttpRequest.

Mithril's m.request uses XMLHttpRequest instead of fetch() for a number of reasons:

  • fetch is not fully standardized yet, and may be subject to specification changes.
  • XMLHttpRequest calls can be aborted before they resolve (e.g. to avoid race conditions in for instant search UIs).
  • XMLHttpRequest provides hooks for progress listeners for long running requests (e.g. file uploads).
  • XMLHttpRequest is supported by all browsers, whereas fetch() is not supported by Internet Explorer and Safari.

Currently, due to lack of browser support, fetch() typically requires a polyfill, which is over 11kb uncompressed - nearly three times larger than Mithril's m.request.

Despite being much smaller, m.request supports many important and not-so-trivial-to-implement features like URL interpolation, querystring serialization and JSON-P requests. The fetch polyfill does not support any of those.

The fetch() API does have a few technical advantages over XMLHttpRequest in a few uncommon cases:

  • it provides a streaming API (in the "video streaming" sense, not in the reactive programming sense), which enables better latency and memory consumption for very large responses (at the cost of code complexity).
  • it integrates to the Service Worker API, which provides an extra layer of control over how and when network requests happen. This API also allows access to push notifications and background synchronization features.

In typical scenarios, streaming won't provide noticeable performance benefits because it's generally not advisable to download megabytes of data to begin with. Also, the memory gains from repeatedly reusing small buffers may be offset or nullified if they result in excessive browser repaints. For those reasons, choosing fetch() streaming instead of m.request is only recommended for extremely resource intensive applications.


Why return streams

Normally, XMLHttpRequest makes HTTP requests to a server asynchronously. This means that it cannot return the response data via a return statement, since the return statement runs synchronously long before the response data is actually available. Therefore, any library that makes requests must expose the response data using some other mechanism.

Some older libraries do so via callback functions, and newer ones (including the fetch API) return promises. m.request returns reactive streams.

Callback functions are the most basic mechanism for asynchronous flow control. They are not composable because they require the callback function to be passed at call time, and error handling mechanisms must similarly be declared upfront.

However, it's desirable to allow the callback function to be defined (and broken into subroutines) in different places than the call site, in order to achieve better separation of concerns. In addition, it's also desirable to wrap an abstraction around errors so that they can be thrown freely and handled safely from a single place, rather than requiring try/catch blocks in every callback function, or duplicating error handling code. The problems that arise from callbacks' lack of composability are infamous enough to earn nicknames such as "callback hell" and "pyramids of doom".

The Promise API is designed to address the shortcomings of callbacks. They are composable, which allows code to be refactored much more elegantly than using callbacks.

In the example below, the code is written in a naive style. It's highly procedural and does many different things: First it requests a project with id 123, then requests a user whose id is the value of project.ownerID, then proceeds to do something useful with the user. If there's an error, it is logged to console.

// AVOID
function doStuff() { /*...*/ }

function json(response) {
	return response.json()
}
function doStuffWithProjectOwner(projectID) {
	fetch("/api/v1/projects/" + projectID, {method: "GET"}).then(json).then(function(project) {
		fetch("/api/v1/users/" + project.ownerID, {method: "GET"}).then(json).then(function(user) {
			doStuff(user)
		})
		.catch(function(e) {
			console.log(e)
		})
	})
	.catch(function(e) {
		console.log(e)
	})
}
doStuffWithProjectOwner(123)

Here's a refactored version that defines composable, easy-to-reuse units, and that takes advantage of the error propagation feature of Promises to avoid repetitive error handling code:

// PREFER
function findProject(id) {
	return fetch("/api/v1/projects/" + id, {method: "GET"}).then(json)
}
function findUser(id) {
	return fetch("/api/v1/users/" + id, {method: "GET"}).then(json)
}
function getProjectOwnerID(project) {
	return project.ownerID
}

function doStuffWithProjectOwner(projectID) {
	return findProject(projectID)
		.then(getProjectOwnerID)
		.then(findUser)
		.then(doStuff)
		.catch(function(e) {
			console.log(e)
		})
}

doStuffWithProjectOwner(123)

The code above separates each request into a findProject and findUser functions which can be used in more use cases than only finding the user object that owns a project.

You can think of .then callbacks as pipes: the getProjectOwnerID receives the response of the findProject request as an input, and return an id, which is then passed as the input to findUser.

The feature of Promises that let us simplify error handling is that promises absorb other promises: in the .then(findUser) line, findUser returns a promise. Instead of a promise being passed as an input to the next callback, the promise chain waits for the findUser promise to complete, and only then continues down the chain of callbacks with the resolved value. If findUser throws an error, the .catch callback handles it, in addition to handling erros from findProject (and from getProjectOwnerID, for that matter).

Promises provide the machinery that facilitates writing small straightforward functions and composing them in flexible ways.

Mithril streams have many similarities to promises. The example above could be written like this:

// PREFER
function findProject(id) {
	return m.request({method: "GET", url: "/api/v1/projects/:id", data: {id: id}})
}
function findUser(id) {
	return m.request({method: "GET", url: "/api/v1/users/:id", data: {id: id}})
}
function getProjectOwnerID(project) {
	return project.ownerID
}

function doStuffWithProjectOwner(projectID) {
	return findProject(projectID)
		.map(getProjectOwnerID)
		.map(findUser)
		.map(doStuff)
		.catch(function(e) {
			console.log(e)
		})
}

doStuffWithProjectOwner(123)

Aside from the API signature difference between fetch and m.request, the only change required to achieve the same functionality was to replace all instances of then with map.

However, stream have some additional interesting properties. Let's suppose project objects have a team property that contains a list of user objects, and we wanted to display a list of designers and a list of developers in a project:

function getProjectTeam(project) {
	return project.team
}
function getTeamUsersByType(team, type) {
	return team.filter(function(user) {
		return user.type === type
	})
}
var project = findProject(123)
var team = project.map(getProjectTeam)
var designers = team.map(function(team) {
	return getTeamUsersByType(team, "designer")
})
var developers = team.map(function(team) {
	return getTeamUsersByType(team, "developer")
})

Now let's suppose that the team changed for the project and we need to fetch the project object from the server again. We would logically also want to update designers and developers so that the UI displays the correct users in their respective lists.

Fortunately, project is a stream, and team, designers and developers are streams derived from project. So to update the state of all these streams, we only need to do this:

findProject(123).map(project)

Doing so updates all the streams, and therefore there's no need to place the filtering code in the view, where the filtering code would recompute the same thing on every render.

Returning streams from m.request streamlines use cases where efficient reactivity is desired, without losing the composable semantics of promises.