It's August and I have decided like the rest of Europe to take some time off. But this does not mean that the project will stop. Life and development will still be occurring.
Today though, the WebPA project has been held high as an example again. This time rather than from inside the project it came from the Programme manager David down a JISC drumming up support for the UK round of IMS award short lists. I would say that any JISC project should have a go. The reward to the project is phenomenal in terms of credit to the project team and also lead institution.
We are also in the process of writing a paper which will hopefully be accepted into the special issue of the BJET. But only time will tell.
However, when back we will be gearing up to make a new release of the WebPA tool, providing people with enough time to get an installation working before the next semester. If you are interested in using WebPA or installing it I suggest that you contact the project. If you do take the WebPA tool and use it you could join our list of adopting institutions.
Showing posts with label JISC. Show all posts
Showing posts with label JISC. Show all posts
Wednesday, 13 August 2008
Thursday, 29 May 2008
Multi SIG meeting
Last week I attended the joint SIG meeting for the JISC CETIS groups on enterprise, portfolios and assessment up in Glasgow. As the developer for the project I tend to try and attend the Enterprise SIG meetings, but so far I have not been able to attend the assessment meetings, due to timing. But more over this was the first time that I would be presenting.
For me the meeting was a huge success. There where a lot of people there who are interested in the WebPA system and what it can provide for them. One person could see positive uses for WebPA in further education colleges that they support. Others could see a use for WebPA in their teaching and institutions. This is all really positive for the project as we have a very unique tool that there seems to be a real need for.
However, I must say that we where not the only project presenting, Alan also provided information on the DELIA project and there where others there to discuss a new standard for schools being proposed the the BSI and much much more. I do tend to find that these meetings are informative and interesting in the variety of topics, projects and subjects that are covered in such a short period of time.
I hope that the interest expressed at the time can translate into people actually downloading and trying the WebPA system for themselves.
For me the meeting was a huge success. There where a lot of people there who are interested in the WebPA system and what it can provide for them. One person could see positive uses for WebPA in further education colleges that they support. Others could see a use for WebPA in their teaching and institutions. This is all really positive for the project as we have a very unique tool that there seems to be a real need for.
However, I must say that we where not the only project presenting, Alan also provided information on the DELIA project and there where others there to discuss a new standard for schools being proposed the the BSI and much much more. I do tend to find that these meetings are informative and interesting in the variety of topics, projects and subjects that are covered in such a short period of time.
I hope that the interest expressed at the time can translate into people actually downloading and trying the WebPA system for themselves.
Monday, 3 March 2008
Other JISC projects - open source, sustainability ... the lot
Following my post last week, related to whether it is feasible for WebPA to become sustainable and the impact of the funding, a post popped up on Rowins blog on essentially the same topic.
Rowin's post is about three JISC funded assessment tools. The three tools though have left becoming open source till their funding has ceased. So what is the future for these projects, well I don't know. I fear that, although there are seven developers and a sourceforge area, there is no wider community to support the future of these projects. Further funding would possibly extend their lives, but as pointed out time and time again, with no community to support the projects, is there a future in the short term worth paying out for.
I would love to know from all of the JISC funded projects, funded at the same time as WebPA;
I know that WebPA is the exception to all of those, but at times it has been a fight to get every ones buy in to the open source ethos and way of doing things. Some of the barriers and limitations on to the project have been discussed in this blog. I hope to continue raising these sometimes awkward points, at least till the funding ends for us too, or in the perfect world we reach sustainability.
Rowin's post is about three JISC funded assessment tools. The three tools though have left becoming open source till their funding has ceased. So what is the future for these projects, well I don't know. I fear that, although there are seven developers and a sourceforge area, there is no wider community to support the future of these projects. Further funding would possibly extend their lives, but as pointed out time and time again, with no community to support the projects, is there a future in the short term worth paying out for.
I would love to know from all of the JISC funded projects, funded at the same time as WebPA;
- how many have released their code under open source,
- how many are beginning to build up a community to support their tools,
- who has waited till the end of the funding to release their tools,
- has any one really shouted loud enough to gather interest in the tools, to build the community's,
- is there any tool which is likely to reach sustainability.
I know that WebPA is the exception to all of those, but at times it has been a fight to get every ones buy in to the open source ethos and way of doing things. Some of the barriers and limitations on to the project have been discussed in this blog. I hope to continue raising these sometimes awkward points, at least till the funding ends for us too, or in the perfect world we reach sustainability.
Wednesday, 20 February 2008
Update on one little action...
The JISC have to day published a press release on WebPA being short listed for the IMS Global Award. Also with the continuing support from OSS-Watch, who also included the WebPA project in one of their latest blog atricles, there is no pressure...
Further to this Rowin has posted on her blog as well.
Further to this Rowin has posted on her blog as well.
Tuesday, 11 December 2007
Talk about TV eating itself
Maybe I was wrong. One of the first talks was about who and why communication is occurring. This covered the dissemination of project information and to view this as a strategic action to ensure the information is reaching the planned, targeted and correct audience. By being strategic we can ensure that we raising awareness of our project as well as encourage implementation and take up of our project.
Talk about TV eating itself, well this is blogging eating itself. One element that was discussed was the feedback mechanism for blogs. I really like having the feedback feature as it allows me to let people interested in the WebPA project follow what I am doing, but also receive feedback from those who have gone through similar things. I also use the blog to let people know what I think about events I am attending or have attended, hence, this entry. What I did not expect was to be part of the talk/ presentation on blogs and RSS feeds.
A lot of interesting conversations have occurred, orientated around the process of blogs. It has been interesting in getting the opinions of the people in the room, to see how they are using, or intending to use blogs. However, the general consensus is that blogs are useful if used correctly. This conclusion has been carefully orchestrated by the presenters, in that the attendees are encouraged to consider both sides.
During the day we also covered; podcasts, wikis and social networking sites. It was also interesting to see the tools and options that are available, as well as discuss how they can be used. Some of the comments about the tools where really valuable. One comment that stuck was about there being a variety of tools available and finding that not everyone has access to the same tools. But personal preference rules, and you can not force anyone into using anything.
Has the event been what I expected yesterday, well... yes and no... what do I mean, well I haven't learnt anything that I didn't already know. But it has been worthwhile in being able to explore other issue that I had not considered. I still think that the title is misleading and does not really describe what you gain from the day. Perhaps this is due to concepts of what Netskills do... but the it was quite refreshing that the day was not technical, about how you install the tools, more about how to use the tools and use them both appropriately and well.
Talk about TV eating itself, well this is blogging eating itself. One element that was discussed was the feedback mechanism for blogs. I really like having the feedback feature as it allows me to let people interested in the WebPA project follow what I am doing, but also receive feedback from those who have gone through similar things. I also use the blog to let people know what I think about events I am attending or have attended, hence, this entry. What I did not expect was to be part of the talk/ presentation on blogs and RSS feeds.
A lot of interesting conversations have occurred, orientated around the process of blogs. It has been interesting in getting the opinions of the people in the room, to see how they are using, or intending to use blogs. However, the general consensus is that blogs are useful if used correctly. This conclusion has been carefully orchestrated by the presenters, in that the attendees are encouraged to consider both sides.
During the day we also covered; podcasts, wikis and social networking sites. It was also interesting to see the tools and options that are available, as well as discuss how they can be used. Some of the comments about the tools where really valuable. One comment that stuck was about there being a variety of tools available and finding that not everyone has access to the same tools. But personal preference rules, and you can not force anyone into using anything.
Has the event been what I expected yesterday, well... yes and no... what do I mean, well I haven't learnt anything that I didn't already know. But it has been worthwhile in being able to explore other issue that I had not considered. I still think that the title is misleading and does not really describe what you gain from the day. Perhaps this is due to concepts of what Netskills do... but the it was quite refreshing that the day was not technical, about how you install the tools, more about how to use the tools and use them both appropriately and well.
Monday, 10 December 2007
Using technology for Effetive Project Communication
Tomorrow I attend an event by the above name. The event is being run by Netskills at the request of JISC to support projects in communication. The blurb states the following;
One element that I am not sure that is being covered is identifying the community. I know that some projects do not widely disseminate their information, but perhaps this is due to them not knowing who to communicate with.
It is okay having all the technology at your finger tips, but if you are not sure about your target audience then how do you select the most appropriate tool for communication. Not all the tools out there are going to be successful. Why would you create and host a forum, if your target audience is not likely to communicate using it. Also the failure of one medium will not ensure the success of another.
I know that this blog is successful in some respects. This is due to the fact that I collect stats, but also that comments have been left and some of the topics of the posts have been the source of discussion else where. But if I were to alter this blog and move to a wiki, where I would have less control and other peoples opinions may obliterate my own and not be relevant to the work of the WebPA Project, then the success would diminish. I might also find that I would be treading all over other peoples toes.
For some projects, the first and only contact with the community is a final report. However, a project is more likely to be successful if it engages with the community throughout its duration, promoting ongoing reflection and allowing audience feedback to direct the project.
Emerging web technologies such as blogs, wikis, pod casts and social networks can provide an effective way to do this. This event will consider best practice in using such technologies in the context of communication and dissemination for your JISC project.
By the end of the workshop participants will have created an action plan for how technology can best support their project communication and dissemination activities.
Really, I think the title for the workshop may be really misleading. Perhaps something more about communicating with your community via technology would have been more appropriate.
One element that I am not sure that is being covered is identifying the community. I know that some projects do not widely disseminate their information, but perhaps this is due to them not knowing who to communicate with.
It is okay having all the technology at your finger tips, but if you are not sure about your target audience then how do you select the most appropriate tool for communication. Not all the tools out there are going to be successful. Why would you create and host a forum, if your target audience is not likely to communicate using it. Also the failure of one medium will not ensure the success of another.
I know that this blog is successful in some respects. This is due to the fact that I collect stats, but also that comments have been left and some of the topics of the posts have been the source of discussion else where. But if I were to alter this blog and move to a wiki, where I would have less control and other peoples opinions may obliterate my own and not be relevant to the work of the WebPA Project, then the success would diminish. I might also find that I would be treading all over other peoples toes.
Thursday, 1 November 2007
Demonstrator Launched
As a project we have assimilated a lot of the information about open source projects and how to be one, from all sources that can be found and in particular those at OSS-Watch. One piece of advice we where given was to make a demonstrator and make it available to potential users to see what the software is about. Well this was realised at the end of October. Within this first week we have had a phenomenal response.
Firstly, Ross from OSS-Watch sent out a very nice comment to the projects JISCmail list, stating that this is a significant step for community development. Secondly, the statistics that are being gathered about the visitors to the site are looking incredible. Already, there are visitors from the UK and the most interesting are the visitors from further afield. It appears that we are getting global interest already. (Not bad for a little JISC funded project with 2 full time staff and another who contributes 1/2 a day a week.)
I hope this has a knock on effect for out fledgling community, by attracting more members. Only time will tell though. But for now I think that all those people who have helped the project get this far, deserve a pat on the back!
Firstly, Ross from OSS-Watch sent out a very nice comment to the projects JISCmail list, stating that this is a significant step for community development. Secondly, the statistics that are being gathered about the visitors to the site are looking incredible. Already, there are visitors from the UK and the most interesting are the visitors from further afield. It appears that we are getting global interest already. (Not bad for a little JISC funded project with 2 full time staff and another who contributes 1/2 a day a week.)
I hope this has a knock on effect for out fledgling community, by attracting more members. Only time will tell though. But for now I think that all those people who have helped the project get this far, deserve a pat on the back!
Monday, 15 October 2007
Measuring the success of WebPA
Last week I attended a JISC workshop on evaluating JISC funded projects. Although a lot of the evaluation seemed to be steered towards the student experience, it did raise a number of points related to evaluating the project. These are especially valid for those projects where a large proportion is related to the development of software.
In the past I have sat in no end of meetings where evaluation has been discussed, and the software is quite often overlooked, or in many cases the evaluation of software is not understood. I have seen no end of project submissions where the evaluation for the software produced is out lined in terms of "the code will be peer reviewed" but as an opensource project that will happen over time and will be carried out by the community that develops for the project rather that a nominated project or organisation. Anyway getting back to the software the evaluation should be in relation to how widely the system is now used and the attitudes of those using the system.
One phrase that came out of the workshop which has stuck with me is "Metrics for Managers". I think this is a good place to start to highlight the types of information that can show the success of WebPA (after all it will be a success). For those who are interested in what WebPA can do for the institution we need to look at the student retention rates, rather that the rather softer student experience. By evaluation the retention rates we may be able to show that with the use of WebPA for peer assessment, the retention rates increase. However, this may be far in advance of what can be done in the time remaining for the delivery of this project.
There are other measures that we can use for the evaluation of WebPA, link the ones that I have highlighted in the past with out even thinking about evaluation. We are already able to collect data related to the download rate of WebPA, we just need to be able to marry this back in to the number of Institutions across the UK and then by sector that have adopted WebPA. This is more difficult that it may seem to begin with. For a start yes we can find out the number of downloads for the software we are receiving (12 to date), but due to the privacy policy for Sourceforge I can not find out any information about who is downloading. This then leads on to the second element, how will we know who is adopting WebPA either on an institutional level or individually in their teaching. The only what of measuring this will be the metrics that we can gather from other areas of the sourceforge system and form contact that we have with institutions and academics. But I do think that these metrics will be in some cases difficult to obtain and also miss out some vital information, however, they will be useful anyway.
Even though evaluation is normally left till the end of the project I think the JISC timing for this event was appropriate. I think that it will trigger project teams to start thinking about what they can evaluate and how, in turn this will enable the teams to start collecting data sooner, rather than scraping around for information and trying to make it fit towards the conclusion of the project funding.
In the past I have sat in no end of meetings where evaluation has been discussed, and the software is quite often overlooked, or in many cases the evaluation of software is not understood. I have seen no end of project submissions where the evaluation for the software produced is out lined in terms of "the code will be peer reviewed" but as an opensource project that will happen over time and will be carried out by the community that develops for the project rather that a nominated project or organisation. Anyway getting back to the software the evaluation should be in relation to how widely the system is now used and the attitudes of those using the system.
One phrase that came out of the workshop which has stuck with me is "Metrics for Managers". I think this is a good place to start to highlight the types of information that can show the success of WebPA (after all it will be a success). For those who are interested in what WebPA can do for the institution we need to look at the student retention rates, rather that the rather softer student experience. By evaluation the retention rates we may be able to show that with the use of WebPA for peer assessment, the retention rates increase. However, this may be far in advance of what can be done in the time remaining for the delivery of this project.
There are other measures that we can use for the evaluation of WebPA, link the ones that I have highlighted in the past with out even thinking about evaluation. We are already able to collect data related to the download rate of WebPA, we just need to be able to marry this back in to the number of Institutions across the UK and then by sector that have adopted WebPA. This is more difficult that it may seem to begin with. For a start yes we can find out the number of downloads for the software we are receiving (12 to date), but due to the privacy policy for Sourceforge I can not find out any information about who is downloading. This then leads on to the second element, how will we know who is adopting WebPA either on an institutional level or individually in their teaching. The only what of measuring this will be the metrics that we can gather from other areas of the sourceforge system and form contact that we have with institutions and academics. But I do think that these metrics will be in some cases difficult to obtain and also miss out some vital information, however, they will be useful anyway.
Even though evaluation is normally left till the end of the project I think the JISC timing for this event was appropriate. I think that it will trigger project teams to start thinking about what they can evaluate and how, in turn this will enable the teams to start collecting data sooner, rather than scraping around for information and trying to make it fit towards the conclusion of the project funding.
Subscribe to:
Posts (Atom)
webpa