{"id":536,"date":"2014-04-02T19:57:24","date_gmt":"2014-04-02T14:57:24","guid":{"rendered":"http:\/\/blogs.nd.edu\/emorgan\/?p=536"},"modified":"2014-04-15T20:46:47","modified_gmt":"2014-04-15T15:46:47","slug":"text-mining-tools","status":"publish","type":"post","link":"https:\/\/sites.nd.edu\/emorgan\/2014\/04\/text-mining-tools\/","title":{"rendered":"Tiny Text Mining Tools"},"content":{"rendered":"<p>\nI have posted to Github the very beginnings of <a href=\"https:\/\/github.com\/ericleasemorgan\/Tiny-Text-Mining-Tools\" target=\"_blank\">Perl library used to support simple and introductory text mining analysis<\/a> &#8212; tiny text mining tools.\n<\/p>\n<p>\nPresently the library is implemented in a set of subroutines stored in a single file supporting:\n<\/p>\n<ul>\n<li>simple in-memory indexing and single-term searching<\/li>\n<li>relevancy ranking through term-frequency inverse document frequency (TFIDF) for searching and classification<\/li>\n<li>cosine similarity for clustering and &#8220;finding more items like this one&#8221;<\/li>\n<\/ul>\n<p>\nI use these subroutines and the associated Perl scripts to do quick &amp; dirty analysis against corpuses of journal articles, books, and websites.\n<\/p>\n<p>\nI know, I know. It would be better to implement these thing as a set of Perl modules, but I&#8217;m practicing what I preach. &#8220;Give it away even if it is not ready.&#8221; The ultimate idea is to package these things into a single distribution, and enable researchers to have them at their finger tips as opposed to a Web-based application.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>I have posted to Github the very beginnings of Perl library used to support simple and introductory text mining analysis &#8212; tiny text mining tools. Presently the library is implemented in a set of subroutines stored in a single file supporting: simple in-memory indexing and single-term searching relevancy ranking through term-frequency inverse document frequency (TFIDF) [&hellip;]<\/p>\n","protected":false},"author":92,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-536","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/sites.nd.edu\/emorgan\/wp-json\/wp\/v2\/posts\/536","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/sites.nd.edu\/emorgan\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sites.nd.edu\/emorgan\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sites.nd.edu\/emorgan\/wp-json\/wp\/v2\/users\/92"}],"replies":[{"embeddable":true,"href":"https:\/\/sites.nd.edu\/emorgan\/wp-json\/wp\/v2\/comments?post=536"}],"version-history":[{"count":1,"href":"https:\/\/sites.nd.edu\/emorgan\/wp-json\/wp\/v2\/posts\/536\/revisions"}],"predecessor-version":[{"id":537,"href":"https:\/\/sites.nd.edu\/emorgan\/wp-json\/wp\/v2\/posts\/536\/revisions\/537"}],"wp:attachment":[{"href":"https:\/\/sites.nd.edu\/emorgan\/wp-json\/wp\/v2\/media?parent=536"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sites.nd.edu\/emorgan\/wp-json\/wp\/v2\/categories?post=536"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sites.nd.edu\/emorgan\/wp-json\/wp\/v2\/tags?post=536"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}