Curling, just not Canadian Style Python 2.6.6 and the urllib2 library
In bash, getting a web page
curl https://www.web-atlanta.com/ >html.html
The bash curl command has nothing to do with Canadian Curling, which is like shuffleboard on ice amidst the tension garnered tolerating a joke about the Queen or the national health care system from a surfboard riding processed cheese eating upper Mexican from south of the barbarian line. In bash, curl is short for client url, a simple http request of a web address.
In Python
x = urllib2.urlopen("https://www.web-atlanta.com")
w = x.read()
And as a part of a class init
def __init__(self,TableName,filename,url):
self.sqhandle=sqlite3.connect(filename) # empty if noexist
self.sq1cursor = self.sqhandle.cursor()
self.filename = filename
try:
self.sq1cursor.execute('''CREATE TABLE '''
+TableName+''' (somenum real, somestring text)''')
self.sqhandle.commit()
except:
print TableName,"table already exists"
self.samples = 0
x = urllib2.urlopen(url)
self.pagedata = x.read()
So if we instantiate a class we now have the html as classname.pagedata and sqlite3 handle and cursor as classname.sqhandle and sq1cursor
We need to do some things with sql like
command = 'INSERT INTO '+table+' VALUES (' + x +', "'+ y +'")'
try:
classname.sq1cursor.execute(command)
classname.sqhandle.commit()
except:
print command
sqlite3 insert a row
def sqlinsert(sqhandle,sq1cursor,table,x,y):
command = 'INSERT INTO '+table+' VALUES (' + x +', "'+ y +'")'
try:
sq1cursor.execute(command)
sqhandle.commit()
except:
print "failed to ", command
