Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

JSON support for test client and response object #1416

Closed
wants to merge 13 commits into from
Closed
1 change: 1 addition & 0 deletions AUTHORS
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,7 @@ Development Lead
Patches and Suggestions
```````````````````````

- Adam Byrtek
- Adam Zapletal
- Ali Afshar
- Chris Edgemon
Expand Down
5 changes: 5 additions & 0 deletions CHANGES
Original file line number Diff line number Diff line change
Expand Up @@ -8,6 +8,11 @@ Version 1.0

(release date to be announced, codename to be selected)

- Added ``is_json`` and ``get_json`` to :class:``flask.wrappers.Response``
in order to make it easier to build assertions when testing JSON responses.
- Added `json` keyword argument to :meth:`flask.testing.FlaskClient.open`
(and related ``get``, ``post``, etc.), which makes it more convenient to
send JSON requests from the test client.

This comment was marked as off-topic.

This comment was marked as off-topic.

- Added before_render_template signal.
- Added `**kwargs` to :meth:`flask.Test.test_client` to support passing
additional keyword arguments to the constructor of
Expand Down
4 changes: 2 additions & 2 deletions docs/api.rst
Original file line number Diff line number Diff line change
Expand Up @@ -29,7 +29,7 @@ Incoming Request Data
---------------------

.. autoclass:: Request
:members:
:members: is_json, get_json

.. attribute:: form

Expand Down Expand Up @@ -141,7 +141,7 @@ Response Objects
----------------

.. autoclass:: flask.Response
:members: set_cookie, data, mimetype
:members: set_cookie, data, mimetype, is_json, get_json

.. attribute:: headers

Expand Down
32 changes: 32 additions & 0 deletions docs/testing.rst
Original file line number Diff line number Diff line change
Expand Up @@ -353,3 +353,35 @@ independently of the session backend used::
Note that in this case you have to use the ``sess`` object instead of the
:data:`flask.session` proxy. The object however itself will provide the
same interface.


Testing JSON APIs
-----------------

.. versionadded:: 1.0

Flask has great support for JSON, and is a popular choice for building REST
APIs. Testing both JSON requests and responses using the test client is very
convenient::

from flask import jsonify

@app.route('/api/auth')
def auth():
json_data = request.get_json()
email = json_data['email']
password = json_data['password']

return jsonify(token=generate_token(email, password))

with app.test_client() as c:
email = 'john@example.com'
password = 'secret'
resp = c.post('/api/auth', json={'login': email, 'password': password})

json_data = resp.get_json()
assert verify_token(email, json_data['token'])

Note that if the ``json`` argument is provided then the test client will put
JSON-serialized data in the request body, and also set the
``Content-Type: application/json`` HTTP header.
13 changes: 12 additions & 1 deletion flask/testing.py
Original file line number Diff line number Diff line change
Expand Up @@ -13,14 +13,15 @@
from contextlib import contextmanager
from werkzeug.test import Client, EnvironBuilder
from flask import _request_ctx_stack
from flask.json import dumps as json_dumps

try:
from werkzeug.urls import url_parse
except ImportError:
from urlparse import urlsplit as url_parse


def make_test_environ_builder(app, path='/', base_url=None, *args, **kwargs):
def make_test_environ_builder(app, path='/', base_url=None, json=None, *args, **kwargs):

This comment was marked as off-topic.

This comment was marked as off-topic.

This comment was marked as off-topic.

"""Creates a new test builder with some application defaults thrown in."""
http_host = app.config.get('SERVER_NAME')
app_root = app.config.get('APPLICATION_ROOT')
Expand All @@ -33,6 +34,16 @@ def make_test_environ_builder(app, path='/', base_url=None, *args, **kwargs):
path = url.path
if url.query:
path += '?' + url.query

if json is not None:
if 'data' in kwargs:
raise ValueError('Client cannot provide both `json` and `data`')
kwargs['data'] = json_dumps(json)

# Only set Content-Type when not explicitly provided
if 'content_type' not in kwargs:
kwargs['content_type'] = 'application/json'

return EnvironBuilder(path, base_url, *args, **kwargs)


Expand Down
202 changes: 107 additions & 95 deletions flask/wrappers.py
Original file line number Diff line number Diff line change
Expand Up @@ -13,19 +13,108 @@
from werkzeug.exceptions import BadRequest

from . import json
from .globals import _request_ctx_stack
from .globals import _app_ctx_stack

_missing = object()

class JSONMixin(object):
"""Common mixin for both request and response objects to provide JSON
parsing capabilities.

def _get_data(req, cache):
getter = getattr(req, 'get_data', None)
if getter is not None:
return getter(cache=cache)
return req.data
.. versionadded:: 1.0
"""

This comment was marked as off-topic.

This comment was marked as off-topic.

This comment was marked as off-topic.


@property
def is_json(self):
"""Indicates if this request/response is in JSON format or not. By
default it is considered to include JSON data if the mimetype is
:mimetype:`application/json` or :mimetype:`application/*+json`.

.. versionadded:: 1.0
"""
mt = self.mimetype
if mt == 'application/json':
return True
if mt.startswith('application/') and mt.endswith('+json'):
return True
return False

@property
def json(self):
"""If this request/response is in JSON format then this property will
contain the parsed JSON data. Otherwise it will be ``None``.

The :meth:`get_json` method should be used instead.
"""
from warnings import warn
warn(DeprecationWarning(
'json is deprecated. Use get_json() instead.'), stacklevel=2)
return self.get_json()

def _get_data_for_json(self, cache):
getter = getattr(self, 'get_data', None)

This comment was marked as off-topic.

This comment was marked as off-topic.

if getter is not None:
return getter(cache=cache)
return self.data

def get_json(self, force=False, silent=False, cache=True):
"""Parses the JSON request/response data and returns it. If parsing
fails :meth:`on_json_loading_failed` will be invoked. By default
this function will only load the JSON data if :attr:`is_json` is true,
but this can be overridden by the `force` parameter.

:param force: if set to ``True`` the mimetype is ignored.
:param silent: if set to ``True`` this method will fail silently
and return ``None``.
:param cache: if set to ``True`` the parsed JSON data is remembered
on the object.
"""
try:
return getattr(self, '_cached_json')
except AttributeError:
pass

if not (force or self.is_json):
return None

# We accept MIME charset header against the specification as certain
# clients have been using this in the past. For responses, we assume
# that if the response charset was set explicitly then the data had
# been encoded correctly as well.
charset = self.mimetype_params.get('charset')
try:
data = self._get_data_for_json(cache)
if charset is not None:
rv = json.loads(data, encoding=charset)
else:
rv = json.loads(data)
except ValueError as e:
if silent:
rv = None
else:
rv = self.on_json_loading_failed(e)
if cache:
self._cached_json = rv
return rv

def on_json_loading_failed(self, e):
"""Called if decoding of the JSON data failed. The return value of
this method is used by :meth:`get_json` when an error occurred. The
default implementation just raises a :class:`BadRequest` exception.

.. versionchanged:: 0.10
Removed buggy previous behavior of generating a random JSON
response. If you want that behavior back you can trivially
add it by subclassing.

.. versionadded:: 0.8
"""
ctx = _app_ctx_stack.top
if ctx is not None and ctx.app.debug:
raise BadRequest('Failed to decode JSON object: {0}'.format(e))
raise BadRequest()

This comment was marked as off-topic.

This comment was marked as off-topic.

This comment was marked as off-topic.



class Request(RequestBase):
class Request(RequestBase, JSONMixin):
"""The request object used by default in Flask. Remembers the
matched endpoint and view arguments.

Expand Down Expand Up @@ -62,7 +151,7 @@ class Request(RequestBase):
@property
def max_content_length(self):
"""Read-only view of the ``MAX_CONTENT_LENGTH`` config key."""
ctx = _request_ctx_stack.top
ctx = _app_ctx_stack.top
if ctx is not None:
return ctx.app.config['MAX_CONTENT_LENGTH']

Expand Down Expand Up @@ -95,103 +184,19 @@ def blueprint(self):
if self.url_rule and '.' in self.url_rule.endpoint:
return self.url_rule.endpoint.rsplit('.', 1)[0]

@property
def json(self):
"""If the mimetype is :mimetype:`application/json` this will contain the
parsed JSON data. Otherwise this will be ``None``.

The :meth:`get_json` method should be used instead.
"""
from warnings import warn
warn(DeprecationWarning('json is deprecated. '
'Use get_json() instead.'), stacklevel=2)
return self.get_json()

@property
def is_json(self):
"""Indicates if this request is JSON or not. By default a request
is considered to include JSON data if the mimetype is
:mimetype:`application/json` or :mimetype:`application/*+json`.

.. versionadded:: 1.0
"""
mt = self.mimetype
if mt == 'application/json':
return True
if mt.startswith('application/') and mt.endswith('+json'):
return True
return False

def get_json(self, force=False, silent=False, cache=True):
"""Parses the incoming JSON request data and returns it. If
parsing fails the :meth:`on_json_loading_failed` method on the
request object will be invoked. By default this function will
only load the json data if the mimetype is :mimetype:`application/json`
but this can be overridden by the `force` parameter.

:param force: if set to ``True`` the mimetype is ignored.
:param silent: if set to ``True`` this method will fail silently
and return ``None``.
:param cache: if set to ``True`` the parsed JSON data is remembered
on the request.
"""
rv = getattr(self, '_cached_json', _missing)
if rv is not _missing:
return rv

if not (force or self.is_json):
return None

# We accept a request charset against the specification as
# certain clients have been using this in the past. This
# fits our general approach of being nice in what we accept
# and strict in what we send out.
request_charset = self.mimetype_params.get('charset')
try:
data = _get_data(self, cache)
if request_charset is not None:
rv = json.loads(data, encoding=request_charset)
else:
rv = json.loads(data)
except ValueError as e:
if silent:
rv = None
else:
rv = self.on_json_loading_failed(e)
if cache:
self._cached_json = rv
return rv

def on_json_loading_failed(self, e):
"""Called if decoding of the JSON data failed. The return value of
this method is used by :meth:`get_json` when an error occurred. The
default implementation just raises a :class:`BadRequest` exception.

.. versionchanged:: 0.10
Removed buggy previous behavior of generating a random JSON
response. If you want that behavior back you can trivially
add it by subclassing.

.. versionadded:: 0.8
"""
ctx = _request_ctx_stack.top
if ctx is not None and ctx.app.config.get('DEBUG', False):
raise BadRequest('Failed to decode JSON object: {0}'.format(e))
raise BadRequest()

def _load_form_data(self):
RequestBase._load_form_data(self)

# In debug mode we're replacing the files multidict with an ad-hoc
# subclass that raises a different error for key errors.
ctx = _request_ctx_stack.top
ctx = _app_ctx_stack.top
if ctx is not None and ctx.app.debug and \
self.mimetype != 'multipart/form-data' and not self.files:
from .debughelpers import attach_enctype_error_multidict
attach_enctype_error_multidict(self)


class Response(ResponseBase):
class Response(ResponseBase, JSONMixin):
"""The response object that is used by default in Flask. Works like the
response object from Werkzeug but is set to have an HTML mimetype by
default. Quite often you don't have to create this object yourself because
Expand All @@ -201,3 +206,10 @@ class Response(ResponseBase):
set :attr:`~flask.Flask.response_class` to your subclass.
"""
default_mimetype = 'text/html'

def _get_data_for_json(self, cache):

This comment was marked as off-topic.

getter = getattr(self, 'get_data', None)
if getter is not None:
# Ignore the cache flag since response doesn't support it
return getter()
return self.data
22 changes: 22 additions & 0 deletions tests/test_testing.py
Original file line number Diff line number Diff line change
Expand Up @@ -13,6 +13,7 @@
import flask

from flask._compat import text_type
from flask.json import jsonify


def test_environ_defaults_from_config():
Expand Down Expand Up @@ -209,6 +210,27 @@ def action():
assert 'gin' in flask.request.form
assert 'vodka' in flask.request.args

def test_json_request_and_response():
app = flask.Flask(__name__)
app.testing = True

@app.route('/echo', methods=['POST'])
def echo():
return jsonify(flask.request.json)

with app.test_client() as c:
json_data = {'drink': {'gin': 1, 'tonic': True}, 'price': 10}
rv = c.post('/echo', json=json_data)

# Request should be in JSON
assert flask.request.is_json
assert flask.request.get_json() == json_data

# Response should be in JSON
assert rv.status_code == 200
assert rv.is_json
assert rv.get_json() == json_data

def test_subdomain():
app = flask.Flask(__name__)
app.config['SERVER_NAME'] = 'example.com'
Expand Down