如何得到JSON从网页到Python脚本

在我的一个脚本中得到以下代码:

#
# url is defined above.
#
jsonurl = urlopen(url)

#
# While trying to debug, I put this in:
#
print jsonurl

#
# Was hoping text would contain the actual json crap from the URL, but seems not...
#
text = json.loads(jsonurl)
print text

我要做的是获得{{.....等.....}}东西，我看到的URL，当我在Firefox加载到我的脚本，所以我可以解析出一个值。我已经谷歌了很多，但我还没有找到一个很好的答案，如何实际得到{{…}}将以.json结尾的URL转换为Python脚本中的对象。

当前回答

从URL获取数据，然后调用json。加载。

Python3例子:

import urllib.request, json 
with urllib.request.urlopen("http://maps.googleapis.com/maps/api/geocode/json?address=google") as url:
    data = json.load(url)
    print(data)

Python2例子:

import urllib, json
url = "http://maps.googleapis.com/maps/api/geocode/json?address=google"
response = urllib.urlopen(url)
data = json.loads(response.read())
print data

输出结果如下所示:

{
"results" : [
    {
    "address_components" : [
        {
            "long_name" : "Charleston and Huff",
            "short_name" : "Charleston and Huff",
            "types" : [ "establishment", "point_of_interest" ]
        },
        {
            "long_name" : "Mountain View",
            "short_name" : "Mountain View",
            "types" : [ "locality", "political" ]
        },
        {
...

2012-10-18 23:26:29

其他回答

这将从Python 2的网页中获取JSON格式的字典。X和Python 3。X:

#!/usr/bin/env python

try:
    # For Python 3.0 and later
    from urllib.request import urlopen
except ImportError:
    # Fall back to Python 2's urllib2
    from urllib2 import urlopen

import json


def get_jsonparsed_data(url):
    """
    Receive the content of ``url``, parse it as JSON and return the object.

    Parameters
    ----------
    url : str

    Returns
    -------
    dict
    """
    response = urlopen(url)
    data = response.read().decode("utf-8")
    return json.loads(data)


url = ("http://maps.googleapis.com/maps/api/geocode/json?"
       "address=googleplex&sensor=false")
print(get_jsonparsed_data(url))

请参见:JSON的读写示例

2015-02-28 20:40:57

我发现这是在使用Python 3时从网页获取JSON的最简单和最有效的方法:

import json,urllib.request
data = urllib.request.urlopen("https://api.github.com/users?since=100").read()
output = json.loads(data)
print (output)

2016-02-23 19:59:52

对于python>=3.6，您可以使用:

import dload

j = dload.json(url)

安装dload:

pip3 install dload

2020-02-24 07:17:01

你可以使用json.dumps:

import json

# Hier comes you received data

data = json.dumps(response)

print(data)

对于加载json并将其写入文件，下面的代码是有用的:

data = json.loads(json.dumps(Response, sort_keys=False, indent=4))
with open('data.json', 'w') as outfile:
json.dump(data, outfile, sort_keys=False, indent=4)

2018-03-23 18:51:58