After getting basic wordpress set up, I figured that I should populate it with whatever stuff I had around from previous plan\/blog\/etc stuff. I had a pretty big set of note-like material in text with either a light wiki or restructured text markup, so I figured that importing them would be good to give the site some real content. There’s some good stuff, and some lame stuff too.<\/p>\n
After some quick poking around, the simplest solution appeared to be to export the site using it’s export to xml feature and use that as a template to reformat my text files into for reimport. Turns out it was pretty easy to get working. The code is pretty ugly and relies on the docutils package: http:\/\/docutils.sourceforge.net\/<\/a><\/p>\n I just need the basic restructured text to html conversion, which this person was nice enough to document: http:\/\/stackoverflow.com\/questions\/6654519\/python-parsing-restructuredtext-into-html <\/a>There are a few additional issues, mostly removal of css elements to make it play nice, but some quick regexps clean those up.<\/p>\n It appears to have basically worked and spot checks of various entries show that the conversion appears to have resulted in mostly-readable text, so I’m happy.<\/p>\n The code is below, I did not code it using Test Driven Development style since I intend to only use it once, so it’s a little ugly…<\/p>\n After getting basic wordpress set up, I figured that I should populate it with whatever stuff I had around from previous plan\/blog\/etc stuff. I had a pretty big set of note-like material in text with either a light wiki or … Continue reading #!python\r\nfrom docutils.core import publish_parts\r\nimport re, glob\r\n\r\ndef format_file(post_id, filename):\r\n\r\n\u00a0\u00a0\u00a0 fh=open(filename)\r\n\r\n\u00a0\u00a0\u00a0 title = \"notes-\"+str(post_id)\r\n\u00a0\u00a0\u00a0 date = \"\"\r\n\u00a0\u00a0\u00a0 year = 0\r\n\u00a0\u00a0\u00a0 month = 0\r\n\u00a0\u00a0\u00a0 month_string = \"\"\r\n\u00a0\u00a0\u00a0 day_of_week = \"Sat\"\r\n\u00a0\u00a0\u00a0 text = \"\"\r\n\u00a0\u00a0\u00a0 html = \"\"\r\n\u00a0\u00a0\u00a0 site_url = \"http:\/\/www.3cats.us\/blog\"\r\n\r\n\u00a0\u00a0\u00a0 match=re.search('(?P<year>\\d+)\\s+(?P<month_string>\\w+)\\s+(?P<day>\\d+)', filename)\r\n\u00a0\u00a0\u00a0 if(match):\r\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 year = int(match.groupdict()['year'])\r\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 month_string = match.groupdict()['month_string']\r\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 month = {'January':1,'February':2,'March':3,'April':4,'May':5,'June':6,'July':7,'August':8,'September':9,'October':10,'November':11,'December':12}[month_string]\r\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 day = int(match.groupdict()['day'])\r\n\r\n\u00a0\u00a0\u00a0 match=re.search('\\s\\-\\s+(.*)\\.[tT][xX][tT]', filename)\r\n\u00a0\u00a0\u00a0 if(match):\r\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 title = match.groups(0)[0]\r\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 #print(title)\r\n\r\n\u00a0\u00a0\u00a0 title_no_whitespace = re.sub('\\s+', '-', title)\r\n\r\n\u00a0\u00a0\u00a0 text = ''.join(fh.readlines())\r\n\u00a0\u00a0\u00a0 html = publish_parts(text,writer_name='html')['html_body']\r\n\u00a0\u00a0\u00a0 striped_html = re.sub('class=\".*?\"','',str(html))\r\n\u00a0\u00a0\u00a0 striped_html = re.sub('<\\\/?div.*?>', '', striped_html)\r\n\r\n\u00a0\u00a0\u00a0 return \"\"\"<item>\r\n\u00a0\u00a0\u00a0 <title>%(title)s<\/title>\r\n\u00a0\u00a0\u00a0 <link>%(site_url)s\/%(year)d\/%(month)d\/%(title_no_whitespace)s\/<\/link>\r\n\u00a0\u00a0\u00a0 <pubDate>%(day_of_week)s, %(day)2.2d %(month_string)s %(year)d 00:00:00 +0000<\/pubDate>\r\n\u00a0\u00a0\u00a0 <dc:creator>Mike<\/dc:creator>\r\n\u00a0\u00a0\u00a0 <guid isPermaLink=\"false\">%(site_url)s\/?p=%(post_id)d<\/guid> <description\/>\r\n\u00a0\u00a0\u00a0 <content:encoded>\r\n%(striped_html)s\r\n\u00a0\u00a0\u00a0 <\/content:encoded>\r\n\u00a0\u00a0\u00a0 <excerpt:encoded>\r\n\u00a0\u00a0\u00a0 <![CDATA[]]>\r\n\u00a0\u00a0\u00a0 <\/excerpt:encoded>\r\n\u00a0\u00a0\u00a0 <wp:post_id>%(post_id)d<\/wp:post_id>\r\n\u00a0\u00a0\u00a0 <wp:post_date>%(year)d-%(month)2.2d-%(day)2.2d 00:00:00<\/wp:post_date>\r\n\u00a0\u00a0\u00a0 <wp:post_date_gmt>%(year)d-%(month)2.2d-%(day)2.2d 00:00:00<\/wp:post_date_gmt>\r\n\u00a0\u00a0\u00a0 <wp:comment_status>closed<\/wp:comment_status>\r\n\u00a0\u00a0\u00a0 <wp:ping_status>closed<\/wp:ping_status>\r\n\u00a0\u00a0\u00a0 <wp:post_name>%(title)s<\/wp:post_name>\r\n\u00a0\u00a0\u00a0 <wp:status>publish<\/wp:status>\r\n\u00a0\u00a0\u00a0 <wp:post_parent>0<\/wp:post_parent>\r\n\u00a0\u00a0\u00a0 <wp:menu_order>0<\/wp:menu_order>\r\n\u00a0\u00a0\u00a0 <wp:post_type>post<\/wp:post_type>\r\n\u00a0\u00a0\u00a0 <wp:post_password\/>\r\n\u00a0\u00a0\u00a0 <wp:is_sticky>0<\/wp:is_sticky>\r\n\u00a0\u00a0\u00a0 <category nicename=\"uncategorized\" domain=\"category\">\r\n\u00a0\u00a0\u00a0 <![CDATA[Uncategorized]]>\r\n\u00a0\u00a0\u00a0 <\/category>\r\n<\/item>\r\n\"\"\"% vars()\r\n\r\nif __name__ == '__main__':\r\n\r\n\u00a0\u00a0\u00a0 print(\"\"\"\r\n<?xml version=\"1.0\" encoding=\"UTF-8\"?>\r\n<!-- generator=\"WordPress\/3.4.2\" created=\"2012-10-04 17:36\" -->\r\n<rss xmlns:wp=\"http:\/\/wordpress.org\/export\/1.2\/\" xmlns:dc=\"http:\/\/purl.org\/dc\/elements\/1.1\/\" xmlns:wfw=\"http:\/\/wellformedweb.org\/CommentAPI\/\" xmlns:content=\"http:\/\/purl.org\/rss\/1.0\/modules\/content\/\" xmlns:excerpt=\"http:\/\/wordpress.org\/export\/1.2\/excerpt\/\" version=\"2.0\"> -<channel> <title>3Cats.us<\/title> <link>http:\/\/www.3cats.us\/blog<\/link> <description>4 Kids, 3 Cats, 2 Parents, 1 God<\/description> <pubDate>Thu, 04 Oct 2012 17:36:15 +0000<\/pubDate> <language>en-US<\/language> <wp:wxr_version>1.2<\/wp:wxr_version> <wp:base_site_url>http:\/\/www.3cats.us\/blog<\/wp:base_site_url> <wp:base_blog_url>http:\/\/www.3cats.us\/blog<\/wp:base_blog_url> -<wp:author><wp:author_id>1<\/wp:author_id><wp:author_login>admin<\/wp:author_login><wp:author_email>mikem@3cats.us<\/wp:author_email>-<wp:author_display_name>\r\n<![CDATA[admin]]>\r\n<\/wp:author_display_name><wp:author_first_name>\r\n<![CDATA[]]>\r\n<\/wp:author_first_name><wp:author_last_name>\r\n<![CDATA[]]>\r\n<\/wp:author_last_name><\/wp:author> <wp:author><wp:author_id>2<\/wp:author_id><wp:author_login>Mike<\/wp:author_login><wp:author_email>mike@3cats.us<\/wp:author_email><wp:author_display_name>\r\n<![CDATA[Mike]]>\r\n<\/wp:author_display_name><wp:author_first_name>\r\n<![CDATA[Mike]]>\r\n<\/wp:author_first_name><wp:author_last_name>\r\n<![CDATA[Miller]]>\r\n<\/wp:author_last_name><\/wp:author> <generator>http:\/\/wordpress.org\/?v=3.4.2<\/generator>\r\n\"\"\")\r\n\r\n\u00a0\u00a0\u00a0 files = glob.glob('.\/Log\/*')\r\n\u00a0\u00a0\u00a0 id=1;\r\n\u00a0\u00a0\u00a0 for file in files:\r\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 print(format_file(id,file))\r\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 id+=1\r\n\u00a0\u00a0\u00a0 print(\"\"\"\r\n<\/channel> <\/rss>\r\n\"\"\")<\/pre>\n","protected":false},"excerpt":{"rendered":"