Sunday, May 17, 2009
I have to write a lecture due May 29th.
Sunday, May 10, 2009
Finally success with creating a clean population data file
I was finally able to get a good clean data set for the world's population data using a different approach. In the original data set there was always a blank row at the end of each yearly table and at the beginning. Between these blank rows was a row with only the table title in column one. This title was a combination of the country name then a slash then the year covered by the table. My easy process was to label each row with the year as another variable. I did this by physically typing the year in the new column beside the title row then filling down in Excel to the blank row at the end of the table. Once I had the first country in this case actually the world tables with the new variable labeling each row in the cooresponding table with the tables year 1996 to 2050, I then copied the year variable to the next country Afghanistan. Then I highlighted both of the year variables for the World and Afghanistan and copied the years to the third and fourth country. Then repeated for the fitth, sixth, seventh and eighth and so on always doubling. This did not take long and it worked because the tables were all repeated with exactly the same number of rows per year table and per country.
The next step was done with brute force copy and paste so took all night but actually I did others tasks on the computer. It really took about as many copy and drag fills as there are countries. I highlighted the table title cell, the column one cell in the title row and then copied out only the country name and pasted this in a second new variable column and then I drag filled this down from 1996 to 2050 so each row concerning one country now had a new variable named Country that contained the name of the country. I then added column headers for variables names, Age_band, Both_genders, Male, Female, Year, Country. I then saved tihs excel file as a CSV file. Then I imported this to SAS. The using a data step where statement I deleted all the blank rows and title rows. So now I have this basic data file.
Knowledge representation and reasoning
- Davis, Martin. The Universal Computer: The Road from Leibniz to Turing (New York: W. W. Norton and Company, 2000).
Wednesday, May 06, 2009
I am starting to write literature review sections.
Saturday, May 02, 2009
I need to pick up the pace on my thesis.
Tuesday, April 28, 2009
Narrative in thesis, music and aborginal studies.
In my early research into knowledge transfer the idea of story telling and narrative came up. But how do I add narrative to computer code? Narrative is a way older workers can relate their knowledge to younger workers. I was just reading the introduction to a book about an epic story. The book is
- Van Deusen, Kira. Kiviuq: An Inuit Hero and His Siberian Cousins (Montreal Que.: McGill-Queens University, 2009).
- The book contains an Inuit legend and compares this legend with Siberian aboriginal legends. This is how stories and lessons of life would be passed down in Inuit culture.
I had also thought to read this book to help my music making but the book and story are not for telling thus to avoid plagiarism I will not read this book. I will simply be inspired by Kira's introduction where she explains briefly that she uses performance art, and music with story telling. She also explains that the elders who told her Kiviuq had given her alone permission to tell this epic. I like these ethics and will respect them.
I also thought, as I read the book, of aboriginal studies but have only read a few aboriginal studies books and will not read this one.
Sunday, April 26, 2009
I started to read another book for my thesis today.
- Levesque, Hector J. and Lakemeyer, Gerhard. The Logic of Knowledge Bases (Cambridge, Mass.: MIT, 2000).
- This covers an introduction to knowledge bases but mostly an introduction to logic
Saturday, April 25, 2009
I am reading the first book in my literature review and it is a good choice for my topic.
- Linda Argote. Organizational Learning: Creating, Retaining and Transferring Knowledge (New York: Kluwer Academic, 1999).
- Argote's research has been on learning curves. These are plots with hours of labour as a dependent variable v cumulative production as the independent x variable. The basic formula for a learning curve is as so: $y = ax^{-b}$. Cumulative production serves as a proxy for knowledge gained by experience in this model.
Tuesday, April 21, 2009
My paper on global demographics got kicked out of the social economy conference.
Saturday, April 18, 2009
I saw my thesis Supervisor yesterday and have not slept since.
Friday, April 10, 2009
I joined the International Association for Statistical Computing.
It is the mission of the IASC to link traditional statistical methodology, modern computer technology, and the knowledge of domain experts in order to convert data into information and knowledge.
Statistical Computing is meant here in its broad sense as Statistics in the Communication and Computer Age and it contains a rich variety of research topics in almost every branch of statistical inquiry.
The topics focused on by the IASC include computational statistics, statistical software, exploratory data analysis, data mining, pattern recognition, statistical graphics and data visualisation, statistical data bases, and related fields.
The IASC works to share and advance methods and techniques related to these topics by facilitating the exchange of information and by stimulating evaluations, research, and development in all areas of statistical computing. It is the aim of the IASC to foster world-wide interest in effective statistical computing and to exchange technical knowledge between researchers world-wide.
IASC promotes collaborative efforts within international, national, regional and other organizations and institutions having similar aims.
I am going to ProQuest, IEEE and ACM databases again for ten more items for background literature..
Thursday, April 09, 2009
I can read in the country data sets in two lines of code.
I figured out how to read in the country data sets in two lines of code. The problem is I need 228 of these pairs of lines. To do this I turn to the automated features of "fill down" in Excel. I am learning that in SAS one can do this with macros. In Excel I have created the first line of code where I set a specific counter based on the position of the countries data in the large file. Once this so called counter or index of numbers is set the second line is a as.data.frame line that reads the large file but only reads the rows( as indicated by the counter/index set of numbers) needed for that country. So today I am going to use Excel to write the second line of code 228 times.
I am still using Inference for R and was mistaken in a sexist way about the representative changing her last name. Of course, many women have two last names and that was all it was. I have only completed the first tutorial for Inference for R and have not yet tried the studio application. This promises to allow breaks while running code.
At this point in testing this Inference for R software, after I have the second lines of code completed I will run this and try printing the Inference for R word document and adding a write up. I may use some of this blog for the write up. I will do this in word. I will after that try to make a Power Point for the conference and start to write up this part of the research. Ideally I will have only a few slides devoted to this part of the project but that show some of the code.
Then it is off to Google or back to the US census site to find data about major industries by country.
Saturday, April 04, 2009
Beautiful quote from the Rae years by Lilith Finkler from Candian Woman Studies
The politics of appropriation are such that a privileged few manage to determine subjects of study and gain recognition as "experts" on a community outside their own. This process becomes particularly insidious when so - called "progressive" individuals claim to be allies of an oppressed group and in so doing, constantly speak on their behalf. This disempowers the people directly affected by a particular experience, since they have less "credibility" and less access to privilege.Finkler, Lilith. Canadian Woman Studies. Downsview: Summer 1993. Vol. 13, Iss. 4; pg. 72.
Inference for R software. Quality issues explored
Practically twenty books or hundreds of journals articles will not work.
My searching of ProQuest that started a year ago is now filtered down to 79 references.
Friday, April 03, 2009
I am co-presenting a paper at a work conference.
Socio-economic Conference 2009
