Saturday, April 18, 2009

I saw my thesis Supervisor yesterday and have not slept since.

I saw my thesis supervisor and he suggested rewriting the section titles of the first three chapter of my thesis. I have not slept because I have been watching hockey, playing computer games and doing work on my home computer. Well enough of all that I will now write my thesis. I have not been reading much these days as I am engulfed in work. I will now take a break from work at home and write my thesis. I must move to my eMac in my office now.

Friday, April 10, 2009

I joined the International Association for Statistical Computing.

Here is the mission statement of the International Association for Statistical Computing.


It is the mission of the IASC to link traditional statistical methodology, modern computer technology, and the knowledge of domain experts in order to convert data into information and knowledge.

Statistical Computing is meant here in its broad sense as Statistics in the Communication and Computer Age and it contains a rich variety of research topics in almost every branch of statistical inquiry.

The topics focused on by the IASC include computational statistics, statistical software, exploratory data analysis, data mining, pattern recognition, statistical graphics and data visualisation, statistical data bases, and related fields.

The IASC works to share and advance methods and techniques related to these topics by facilitating the exchange of information and by stimulating evaluations, research, and development in all areas of statistical computing. It is the aim of the IASC to foster world-wide interest in effective statistical computing and to exchange technical knowledge between researchers world-wide.

IASC promotes collaborative efforts within international, national, regional and other organizations and institutions having similar aims.

I am going to ProQuest, IEEE and ACM databases again for ten more items for background literature..

I feel I am done now searching out the knowledge management items for my thesis. I hope the next ten items are easier as I plan to search out simulations, programming and other methods literature now.

Thursday, April 09, 2009

I can read in the country data sets in two lines of code.

I figured out how to read in the country data sets in two lines of code. The problem is I need 228 of these pairs of lines. To do this I turn to the automated features of "fill down" in Excel. I am learning that in SAS one can do this with macros. In Excel I have created the first line of code where I set a specific counter based on the position of the countries data in the large file. Once this so called counter or index of numbers is set the second line is a as.data.frame line that reads the large file but only reads the rows( as indicated by the counter/index set of numbers) needed for that country. So today I am going to use Excel to write the second line of code 228 times.

I am still using Inference for R and was mistaken in a sexist way about the representative changing her last name. Of course, many women have two last names and that was all it was. I have only completed the first tutorial for Inference for R and have not yet tried the studio application. This promises to allow breaks while running code.

At this point in testing this Inference for R software, after I have the second lines of code completed I will run this and try printing the Inference for R word document and adding a write up. I may use some of this blog for the write up. I will do this in word. I will after that try to make a Power Point for the conference and start to write up this part of the research. Ideally I will have only a few slides devoted to this part of the project but that show some of the code.

Then it is off to Google or back to the US census site to find data about major industries by country.

Saturday, April 04, 2009

Beautiful quote from the Rae years by Lilith Finkler from Candian Woman Studies

Can you guess who her populations is, and why she was not given full academic rights at this conference even thought she was qualified academically but because she belonged to the subject population she was treated differently?
The politics of appropriation are such that a privileged few manage to determine subjects of study and gain recognition as "experts" on a community outside their own. This process becomes particularly insidious when so - called "progressive" individuals claim to be allies of an oppressed group and in so doing, constantly speak on their behalf. This disempowers the people directly affected by a particular experience, since they have less "credibility" and less access to privilege.
Finkler, Lilith. Canadian Woman Studies. Downsview: Summer 1993. Vol. 13, Iss. 4; pg. 72.

Inference for R software. Quality issues explored

I won't post something technical about inference for R here. The representative who contacted me from that company has now changed her last name in emails. And one search at Google found this debate from some noted statisticians about Inference for R as a spam marketed software. I was worried because I was approached outside of work. I am now finding that persons who contact me here about math have questionable ethics in terms of robbing Open Source projects. But this could just be theft. I may not be able to as careful in the future. May be Inference for R is a more nefarious product. I will need to search further and perhaps contact a computer security service now and inquire about this company and software. Perhaps it will all turn out to be an aggressive slightly unethical marketing side to a good software.

Practically twenty books or hundreds of journals articles will not work.

The two master's thesis advisers I saw who did not take me on as a student both offered the advice of not doing too much work on the thesis. I am realising now that twenty books would be too much. So just like a short list of twenty references is better than hundreds of references, a twenty item list with journal articles is also much more practical in terms of getting it done. Also books are not as easy to vet I think at present. Perhaps there are simple vetting processes for books but I am not able to know or express these simple processes right now. So I am cutting books down on the list and adding more peer reviewed papers. I am also focusing less on the seven components of operational knowledge and instead on knowledge loss and knowledge retention. Much better and seems like it will be much easier.

My searching of ProQuest that started a year ago is now filtered down to 79 references.

I am attempting to find the 20 classic references to the problem of Knowledge Loss. I may have nine or ten references now and these are books. I should be adding peer reviewed journals. I should cut some of these books and add more journal articles. I have only one or two classic knowledge management books and these two I will keep. And I have two methods books. And I have two knowledge loss books. I am looking right now at the possibility of narrowing down the 79 present references. I also now have the idea that I should perform a search on ProQuest and Google scholar for the term Knowledge Loss and find about 15 papers that way. After all, the previous searching that is now narrowed to 79 papers, was about searching for ways to measure knowledge. What I really need is papers on the main topic: Knowledge loss. Also I think ten books is too many books. So I will cut the book list to the six books mentioned above and cut the previous search to five or so papers then find ten or so peer reviewed papers on Knowledge Loss.

Thursday, April 02, 2009

I have made it to ten references now.

I feeling slightly pressured to complete my literature review. But I now have ten items on the list so am two days behind only. I say two days behind because I set a goal on Sunday of adding one item per day to be done early for the next meeting with Dr. Kiringa my thesis supervisor. I am just printing the ten item list now and blogging a bit about my home computers. I am also starting to register for courses at work in statistical computing. This reminds me to choose courses from the School of the Public Service which means first I need to check in this morning with my career vision for the next five years. I created this vision at my course last week.

Monday, March 30, 2009

I installed Microsoft Project 2007 and will use it to plan my thesis work.

I installed Microsoft Project 2007 on Remembrance and made a file for the thesis I am working on in graduate school.

Sunday, March 29, 2009

I plan to find five more classic literature items today

I started to look up the references in Continuity Management and found some but some are off the Internet now. I plan to find five more references today so as to be on schedule for my April 15th deadline for my literature review. I must read references found on this list this summer. I need to have about 20 items.

Saturday, March 28, 2009

Progress with spring paper: I can read by 21 rows now and have all the population data into 18 datasets

I have now read all my data into 18 age band data sets and just need to now join these 18 data sets and then split these every 21*23 rows into 228 data sets and then again split this into 23 yearly tables. So the end result should be 227 countries and one world data sets with population for both genders and population for each of male and female by 17 age bands and total all ages, and 23 yearly tables for each country.

This is giving me an idea for the analysis. This idea is to use the 18 data sets and call these the age band data sets(18). Then I want to have 227 country and one world data sets and call these the country data sets(228). Then also have 23 data sets for years and call these the years data sets(23). Then I will work comparing these data sets for my populations analysis.

In fact, rather than join these data sets I have now, the age band data sets to get the other data sets, I should instead simply read in the data for each data set. So my next reading in will be for the 227 countries and one world data sets. Then the third step will be to read in the data into years data sets.

I also need to start looking at a data source for finding the top three industries in each of the 228 countries. May be one google search like I did to find the population data will work.

I have started using Inference for R software and can code with this documentation software now.

I was offered a chance to test out Inference for R. This software it seems interfaces R with Microsoft Office. I have so far used it in both Word and Excel. Because it is an interface it is faster than copying and pasting code into the R command line window and also is faster because when you change code and run that changed code as in debugging you do not lose the code typed on the command line. I had in the past changed my code on the command line and would have to copy my successful code back to my text editor to keep a record of what I was doing.

One big problem for Inference for R is that it is only available on one platform. I am having to move back to the Windows world of computers because of statistics software like Inference for R, SAS and Excel and also because of the game Eve Online which is mostly a windows based game.

My computers are working well. I am having to use Windows at school and work.

My eMac is functioning fine and I even found the DVD drive working again. The Macbook although it is filthy is working fine as my usual daily machine now in the living room, The new home built PC with Windows XP 64 bit and Debian Linux is also working fine now. The new Dell Mini 9 Netbook is fine and I carry it around all the time but it is not getting much use but it is very useful to have it if needed. I used it at a community group last week to keep minutes of a meeting.

I am thinking of buying a Windows laptop that I would build from an OCZ laptop skeleton. This PC laptop would also be running Windows XP 64 bit and Debian 4.2. I am also thinking of buying an iMac 20 inch desktop. I am looking at used MacBooks and Powerbooks and iBooks for a friend and perhaps one for myself for music recording. I am looking in the 200-400 dollar range for these. These would be running Tiger not Leopard for an OS.

Friday, March 20, 2009

Getting books and papers organized: Shelves I use for books.

We have a coffee table with six shelves in our living room. I am dedicating one shelf now for my thesis literature. The shelf under that is for statistics and Internet studies books. One shelf is for remotes, another for phone books, another for non paper items and then one for my partner's books and journals. I also have numerous shelves around the apartment for other subjects like the ones in the dinning area for, music, engineering, fine art, poetry and drama, science fiction, TV and film, social sciences, radical books, classic literature, philosophy and religion, and geography. In the office are shelves for computer books, nature books, hard science books, political science and peace literature, math books, two shelves for statistics books and notes, a shelf for storing cables and connectors and other loose computer stuff. Another shelf is used just for camera stuff. Four shelves are used to store computer parts, and one CD cabinet is used to store disks, I have shelves for personal papers including one for bills and two shelves with magazine boxes to organize school notes and other papers. I have shelves in there for classic games like chess and GO. I have a shelf for Internet studies and guides. I have shelf for cyberpunk fiction. Plus I have a rolling file cabinet where old agenda books, school admin papers and pens and other miscellaneous stuff is kept. I have four shelves for bankers boxes of old school notes, magazines and old bills and old school calendars. Plus I have a shelf where I store old journals and old daily accounts. All in all most of the stuff has a place to go and be put away.

Literature search and studies update

After meeting my supervisor I felt confident that my thesis is progressing well. I am focused on the literature search and my paper for a conference in social economy in two months. These are the two basic tasks at present. I will need to find the twenty classic references for my topic. Then I will spend the summer term reading these references. I have four items in mind so far for this twenty item list.

In health reading I am reading about stress management. In entertainment reading I am reading two books about guitar. In programming I am studying SAS, Excel and have numerous computer "language" books. I will need to learn to program in Java or C++ this summer.

Thursday, March 19, 2009

I was unable to import the data in R or in SAS so I am working in Excel.

I was unable so far to import the world population data into R or into SAS. I was trying to do this to allow me to automate the finding process for baby booms. Instead, I am doing the discovery with my eyes using the highlighted column created with conditional formatting in Excel. I wrote about this conditional formatting in my last post. I started with the last country in the Z's and am now on the T's. I have about 270,000 records and am now at about 200,000 records so am about 1/4 done so this will be possible in Excel. I am making a separate worksheet for each country that shows a suspected boom and then copying and pasting the tables from 1996 to 2050 for each suspect country into its own worksheet. So then I can save each work sheet as a csv text file for one country at a time. Then I can try to import one country's data at a time into a more sophisticated statistical analysis software. That will be my next step when this discovery step is completed.

Sunday, March 15, 2009

Progress with my paper for the May graduate conference in social economy.

I have created columns next to the total population and male and female population counts columns that subtract a given age band from the previous age band. Thus if these new columns are negative it means a given age band is larger than the younger age band before it. For instance, if there are 300,000 persons aged 5 to 9 years old and there are only 200,000 babies aged 0-4 years old in a country in say 1996 then the next columns shows - 100,000. I then used conditional formatting to highlight the new column if a value was negative. This has given me a way of visually finding any suspected baby booms. But I still desire R code that will scan these new columns and produce a data set of only the population tables where these negative values occur. At this point, as well I have been offered the use of a documentation software to document in Office 2007 format, my use of R code.

I have some idea of the required indexes in the data set to use in R loops or array indexes. These are the re-occurrence rows of data in the large data set. In other words starting with the World population data tables then going from country names starting at A then down to Z we have repeated tables starting in 1996 to 2010 for each year and then 2015 and basically every five years projected until 2050. So there are tables in two dimensions, country names and then years. I will limit my searches to 1996 to 2005 at first but then if I am choosing a country as having booms in this decade of years 1996 to 2005, I will come back to the projections for the future.

I also need to get the path's right to open data files using R on windows. So once this path problem is solved I can move ahead with trying index's to parse the large data set into a smaller data set with only population tables that indicate a suspected baby boom.