In: |
net/http.rb
|
Parent: | Protocol |
This library provides your program functions to access WWW documents via HTTP, Hyper Text Transfer Protocol version 1.1. For details of HTTP, refer [RFC2616] (www.ietf.org/rfc/rfc2616.txt).
(formal version)
require 'net/http' Net::HTTP.start('www.example.com', 80) { |http| response = http.get('/index.html') puts response.body }
(shorter version)
require 'net/http' Net::HTTP.get_print 'www.example.com', '/index.html' or require 'net/http' require 'uri' Net::HTTP.get_print URI.parse('http://www.example.com/index.html')
require 'net/http' Net::HTTP.start('some.www.server', 80) { |http| response = http.post('/cgi-bin/search.rb', 'query=ruby') }
Net::HTTP.Proxy creates http proxy class. It has same methods of Net::HTTP but its instances always connect to proxy, instead of given host.
require 'net/http' proxy_addr = 'your.proxy.host' proxy_port = 8080 : Net::HTTP::Proxy(proxy_addr, proxy_port).start('www.example.com') {|http| # always connect to your.proxy.addr:8080 : }
Since Net::HTTP.Proxy returns Net::HTTP itself when proxy_addr is nil, there’s no need to change code if there’s proxy or not.
There are two additional parameters in Net::HTTP.Proxy which allow to specify proxy user name and password:
Net::HTTP::Proxy(proxy_addr, proxy_port, proxy_user = nil, proxy_pass = nil)
You may use them to work with authorization-enabled proxies:
require 'net/http' require 'uri' proxy_host = 'your.proxy.host' proxy_port = 8080 uri = URI.parse(ENV['http_proxy']) proxy_user, proxy_pass = uri.userinfo.split(/:/) if uri.userinfo Net::HTTP::Proxy(proxy_host, proxy_port, proxy_user, proxy_pass).start('www.example.com') {|http| # always connect to your.proxy.addr:8080 using specified username and password : }
Note that net/http never rely on HTTP_PROXY environment variable. If you want to use proxy, set it explicitly.
require 'net/http' require 'uri' def fetch( uri_str, limit = 10 ) # You should choose better exception. raise ArgumentError, 'HTTP redirect too deep' if limit == 0 response = Net::HTTP.get_response(URI.parse(uri_str)) case response when Net::HTTPSuccess then response when Net::HTTPRedirection then fetch(response['location'], limit - 1) else response.error! end end print fetch('http://www.ruby-lang.org')
Net::HTTPSuccess and Net::HTTPRedirection is a HTTPResponse class. All HTTPResponse objects belong to its own response class which indicate HTTP result status. For details of response classes, see section "HTTP Response Classes".
require 'net/http' Net::HTTP.start('www.example.com') {|http| req = Net::HTTP::Get.new('/secret-page.html') req.basic_auth 'account', 'password' response = http.request(req) print response.body }
TODO: write me.
You can use net/http.rb 1.1 features (bundled with Ruby 1.6) by calling HTTP.version_1_1. Calling Net::HTTP.version_1_2 allows you to use 1.2 features again.
# example Net::HTTP.start { |http1| ...(http1 has 1.2 features)... } Net::HTTP.version_1_1 Net::HTTP.start { |http2| ...(http2 has 1.1 features)... } Net::HTTP.version_1_2 Net::HTTP.start { |http3| ...(http3 has 1.2 features)... }
This function is NOT thread-safe.
new | -> | newobj |
request_put | -> | put2 |
address | [R] | The host name to connect to. |
close_on_empty_response | [RW] | |
open_timeout | [RW] | Seconds to wait until connection is opened. If the HTTP object cannot open a connection in this many seconds, it raises a TimeoutError exception. |
port | [R] | The port number to connect to. |
proxy_address | [R] | |
proxy_pass | [R] | |
proxy_port | [R] | |
proxy_user | [R] | |
read_timeout | [R] | Seconds to wait until reading one block (by one read(2) call). If the HTTP object cannot open a connection in this many seconds, it raises a TimeoutError exception. |
Creates an HTTP proxy class. Arguments are address/port of proxy host and username/password if authorization on proxy server is required. You can replace the HTTP class with created proxy class.
If ADDRESS is nil, this method returns self (Net::HTTP).
# Example proxy_class = Net::HTTP::Proxy('proxy.example.com', 8080) : proxy_class.start('www.ruby-lang.org') {|http| # connecting proxy.foo.org:8080 : }
# File net/http.rb, line 484 def HTTP.Proxy(p_addr, p_port = nil, p_user = nil, p_pass = nil) return self unless p_addr delta = ProxyDelta proxyclass = Class.new(self) proxyclass.module_eval { include delta # with proxy @is_proxy_class = true @proxy_address = p_addr @proxy_port = p_port || default_port() @proxy_user = p_user @proxy_pass = p_pass } proxyclass end
Send a GET request to the target and return the response as a string. The target can either be specified as (uri), or as (host, path, port = 80); so:
print Net::HTTP.get(URI.parse('http://www.example.com/index.html'))
or:
print Net::HTTP.get('www.example.com', '/index.html')
# File net/http.rb, line 262 def HTTP.get(arg1, arg2 = nil, arg3 = nil) get_response(arg1,arg2,arg3).body end
Get body from target and output it to +$stdout+. The target can either be specified as (uri), or as (host, path, port = 80); so:
Net::HTTP.get_print URI.parse('http://www.example.com/index.html')
or:
Net::HTTP.get_print('www.example.com', '/index.html')
# File net/http.rb, line 237 def HTTP.get_print(arg1, arg2 = nil, port = nil) if arg2 addr, path = arg1, arg2 else uri = arg1 addr = uri.host path = uri.request_uri port = uri.port end new(addr, port || HTTP.default_port).start {|http| http.get path, nil, $stdout } nil end
Send a GET request to the target and return the response as a Net::HTTPResponse object. The target can either be specified as (uri), or as (host, path, port = 80); so:
res = Net::HTTP.get_response(URI.parse('http://www.example.com/index.html')) print res.body
or:
res = Net::HTTP.get_response('www.example.com', '/index.html') print res.body
# File net/http.rb, line 278 def HTTP.get_response(arg1, arg2 = nil, arg3 = nil) if arg2 get_by_path(arg1, arg2, arg3) else get_by_uri(arg1) end end
Creates a new Net::HTTP object. If proxy_addr is given, creates an Net::HTTP object with proxy support. This method does not open the TCP connection.
# File net/http.rb, line 332 def new(address, port = nil, p_addr = nil, p_port = nil, p_user = nil, p_pass = nil) obj = Proxy(p_addr, p_port, p_user, p_pass).newobj(address, port) setimplversion obj obj end
Creates a new Net::HTTP object for the specified address. This method does not open the TCP connection.
# File net/http.rb, line 341 def initialize(address, port = nil) @address = address @port = (port || HTTP.default_port) @curr_http_version = HTTPVersion @seems_1_0_server = false @close_on_empty_response = false @socket = nil @started = false @open_timeout = 30 @read_timeout = 60 @debug_output = nil end
returns true if self is a class which was created by HTTP::Proxy.
# File net/http.rb, line 502 def proxy_class? @is_proxy_class end
creates a new Net::HTTP object and opens its TCP connection and HTTP session. If the optional block is given, the newly created Net::HTTP object is passed to it and closed when the block finishes. In this case, the return value of this method is the return value of the block. If no block is given, the return value of this method is the newly created Net::HTTP object itself, and the caller is responsible for closing it upon completion.
# File net/http.rb, line 323 def start(address, port = nil, p_addr = nil, p_port = nil, p_user = nil, p_pass = nil, &block) # :yield: +http+ new(address, port, p_addr, p_port, p_user, p_pass).start(&block) end
Turns on net/http 1.1 (ruby 1.6) features. Defaults to OFF in ruby 1.8.
# File net/http.rb, line 195 def HTTP.version_1_1 @@newimpl = false end
true if net/http is in version 1.1 compatible mode. Defaults to true.
# File net/http.rb, line 207 def HTTP.version_1_1? not @@newimpl end
Turns on net/http 1.2 (ruby 1.8) features. Defaults to ON in ruby 1.8.
I strongly recommend to call this method always.
require 'net/http' Net::HTTP.version_1_2
# File net/http.rb, line 189 def HTTP.version_1_2 @@newimpl = true end
true if net/http is in version 1.2 mode. Defaults to true.
# File net/http.rb, line 201 def HTTP.version_1_2? @@newimpl end
Gets data from path on the connected-to host. header must be a Hash like { ‘Accept’ => ’*/*’, … }.
In version 1.1 (ruby 1.6), this method returns a pair of objects, a Net::HTTPResponse object and the entity body string. In version 1.2 (ruby 1.8), this method returns a Net::HTTPResponse object.
If called with a block, yields each fragment of the entity body in turn as a string as it is read from the socket. Note that in this case, the returned response object will not contain a (meaningful) body.
dest argument is obsolete. It still works but you must not use it.
In version 1.1, this method might raise an exception for 3xx (redirect). In this case you can get a HTTPResponse object by "anException.response".
In version 1.2, this method never raises exception.
# version 1.1 (bundled with Ruby 1.6) response, body = http.get('/index.html') # version 1.2 (bundled with Ruby 1.8 or later) response = http.get('/index.html') # using block File.open('result.txt', 'w') {|f| http.get('/~foo/') do |str| f.write str end }
# File net/http.rb, line 613 def get(path, initheader = nil, dest = nil, &block) # :yield: +body_segment+ res = nil request(Get.new(path, initheader)) {|r| r.read_body dest, &block res = r } unless @newimpl res.value return res, res.body end res end
Gets only the header from path on the connected-to host. header is a Hash like { ‘Accept’ => ’*/*’, … }.
This method returns a Net::HTTPResponse object.
In version 1.1, this method might raise an exception for 3xx (redirect). On the case you can get a HTTPResponse object by "anException.response". In version 1.2, this method never raises an exception.
response = nil Net::HTTP.start('some.www.server', 80) {|http| response = http.head('/index.html') } p response['content-type']
# File net/http.rb, line 643 def head(path, initheader = nil) res = request(Head.new(path, initheader)) res.value unless @newimpl res end
# File net/http.rb, line 357 def inspect "#<#{self.class} #{@address}:#{@port} open=#{started?}>" end
Posts data (must be a String) to path. header must be a Hash like { ‘Accept’ => ’*/*’, … }.
In version 1.1 (ruby 1.6), this method returns a pair of objects, a Net::HTTPResponse object and an entity body string. In version 1.2 (ruby 1.8), this method returns a Net::HTTPResponse object.
If called with a block, yields each fragment of the entity body in turn as a string as it are read from the socket. Note that in this case, the returned response object will not contain a (meaningful) body.
dest is an alternative method of collecting the body. It must be an object responding to the "<<" operator (such as a String or an Array). Each fragment of the entity body will be "<<"-ed in turn onto dest if provided, and it will also become the body of the returned response object.
You must not provide both dest and a block; doing so will result in an ArgumentError.
In version 1.1, this method might raise an exception for 3xx (redirect). In this case you can get an HTTPResponse object by "anException.response". In version 1.2, this method never raises exception.
# version 1.1 response, body = http.post('/cgi-bin/search.rb', 'query=foo') # version 1.2 response = http.post('/cgi-bin/search.rb', 'query=foo') # using block File.open('result.txt', 'w') {|f| http.post('/cgi-bin/search.rb', 'query=foo') do |str| f.write str end }
# File net/http.rb, line 688 def post(path, data, initheader = nil, dest = nil, &block) # :yield: +body_segment+ res = nil request(Post.new(path, initheader), data) {|r| r.read_body dest, &block res = r } unless @newimpl res.value return res, res.body end res end
Address of proxy host. If self does not use a proxy, nil.
# File net/http.rb, line 518 def proxy_address self.class.proxy_address end
User password for accessing proxy. If self does not use a proxy, nil.
# File net/http.rb, line 533 def proxy_pass self.class.proxy_pass end
Port number of proxy host. If self does not use a proxy, nil.
# File net/http.rb, line 523 def proxy_port self.class.proxy_port end
User name for accessing proxy. If self does not use a proxy, nil.
# File net/http.rb, line 528 def proxy_user self.class.proxy_user end
Setter for the read_timeout attribute.
# File net/http.rb, line 392 def read_timeout=(sec) @socket.read_timeout = sec if @socket @read_timeout = sec end
Sends an HTTPRequest object REQUEST to the HTTP server. This method also sends DATA string if REQUEST is a post/put request. Giving DATA for get/head request causes ArgumentError.
When called with a block, yields an HTTPResponse object. The body of this response will not have been read yet; the caller can process it using HTTPResponse#read_body, if desired.
Returns a HTTPResponse object.
This method never raises Net::* exceptions.
# File net/http.rb, line 819 def request(req, body = nil, &block) # :yield: +response+ unless started? start { req['connection'] ||= 'close' return request(req, body, &block) } end if proxy_user() req.proxy_basic_auth proxy_user(), proxy_pass() end begin_transport req req.exec @socket, @curr_http_version, edit_path(req.path), body begin res = HTTPResponse.read_new(@socket) end while HTTPContinue === res res.reading_body(@socket, req.response_body_permitted?) { yield res if block_given? } end_transport req, res res end
Sends a GET request to the path and gets a response, as an HTTPResponse object.
When called with a block, yields an HTTPResponse object. The body of this response will not have been read yet; the caller can process it using HTTPResponse#read_body, if desired.
Returns the response.
This method never raises Net::* exceptions.
response = http.request_get('/index.html') # The entity body is already read here. p response['content-type'] puts response.body # using block http.request_get('/index.html') {|response| p response['content-type'] response.read_body do |str| # read body now print str end }
# File net/http.rb, line 733 def request_get(path, initheader = nil, &block) # :yield: +response+ request(Get.new(path, initheader), &block) end
Sends a HEAD request to the path and gets a response, as an HTTPResponse object.
Returns the response.
This method never raises Net::* exceptions.
response = http.request_head('/index.html') p response['content-type']
# File net/http.rb, line 747 def request_head(path, initheader = nil, &block) request(Head.new(path, initheader), &block) end
Sends a POST request to the path and gets a response, as an HTTPResponse object.
When called with a block, yields an HTTPResponse object. The body of this response will not have been read yet; the caller can process it using HTTPResponse#read_body, if desired.
Returns the response.
This method never raises Net::* exceptions.
# example response = http.request_post('/cgi-bin/nice.rb', 'datadatadata...') p response.status puts response.body # body is already read # using block http.request_post('/cgi-bin/nice.rb', 'datadatadata...') {|response| p response.status p response['content-type'] response.read_body do |str| # read body now print str end }
# File net/http.rb, line 777 def request_post(path, data, initheader = nil, &block) # :yield: +response+ request Post.new(path, initheader), data, &block end
Sends an HTTP request to the HTTP server. This method also sends DATA string if DATA is given.
Returns a HTTPResponse object.
This method never raises Net::* exceptions.
response = http.send_request('GET', '/index.html') puts response.body
# File net/http.rb, line 801 def send_request(name, path, data = nil, header = nil) r = HTTPGenericRequest.new(name,(data ? true : false),true,path,header) request r, data end
WARNING This method causes serious security hole. Never use this method in production code.
Set an output stream for debugging.
http = Net::HTTP.new http.set_debug_output $stderr http.start { .... }
# File net/http.rb, line 370 def set_debug_output(output) warn 'Net::HTTP#set_debug_output called after HTTP started' if started? @debug_output = output end
Opens TCP connection and HTTP session.
When this method is called with block, gives a HTTP object to the block and closes the TCP connection / HTTP session after the block executed.
When called with a block, returns the return value of the block; otherwise, returns self.
# File net/http.rb, line 415 def start # :yield: http raise IOError, 'HTTP session already opened' if @started if block_given? begin do_start return yield(self) ensure do_finish end end do_start self end