Curling, just not Canadian Style Python 2.6.6 and the urllib2 library
In bash, getting a web page
curl https://www.web-atlanta.com/ >html.html
The bash curl command has nothing to do with Canadian Curling, which is like shuffleboard on ice amidst the tension garnered tolerating a joke about the Queen or the national health care system from a surfboard riding processed cheese eating upper Mexican from south of the barbarian line. In bash, curl is short for client url, a simple http request of a web address.
In Python
x = urllib2.urlopen("https://www.web-atlanta.com") w = x.read()
And as a part of a class init
def __init__(self,TableName,filename,url): self.sqhandle=sqlite3.connect(filename) # empty if noexist self.sq1cursor = self.sqhandle.cursor() self.filename = filename try: self.sq1cursor.execute('''CREATE TABLE ''' +TableName+''' (somenum real, somestring text)''') self.sqhandle.commit() except: print TableName,"table already exists" self.samples = 0 x = urllib2.urlopen(url) self.pagedata = x.read()
So if we instantiate a class we now have the html as classname.pagedata and sqlite3 handle and cursor as classname.sqhandle and sq1cursor
We need to do some things with sql like
command = 'INSERT INTO '+table+' VALUES (' + x +', "'+ y +'")' try: classname.sq1cursor.execute(command) classname.sqhandle.commit() except: print command
sqlite3 insert a row
def sqlinsert(sqhandle,sq1cursor,table,x,y): command = 'INSERT INTO '+table+' VALUES (' + x +', "'+ y +'")' try: sq1cursor.execute(command) sqhandle.commit() except: print "failed to ", command