Effective approach in making Capstone project a holistic learning experience to students of undergraduate computer science engineering program

Deepamala N; Shobha G

Effective approach in making capstone project a holistic learning experience to students of undergraduate computer science engineering program

EFFECTIVE APPROACH IN MAKING CAPSTONE PROJECT A HOLISTIC LEARNING EXPERIENCE TO STUDENTS OF UNDERGRADUATE COMPUTER SCIENCE ENGINEERING PROGRAM

N. Deepamala

, G. Shobha

R.V. College of Engineering (India)

Received March 2018

Accepted July 2018

Abstract

Final year or Capstone Project is the final and important phase of the undergraduate curriculum in a Computer Science Engineering program. Final year project is a course where all the skills learnt by the students in the course are applied and evaluated. The important aspects in the delivery of this course are (i) developing a model to train the students to deliver quality project work and documentation, (ii) effective evaluation of the student based on rubrics which are mapped to the course outcomes (iii) Calculate program outcome and course outcome attainment and make necessary changes to improve the delivery of the course (iv) Map the feedback from stakeholders as per graduate attributes and measure performance. This paper discusses the approach followed for three academic years 2014-2017 on a batch of 180 students per year. Training sessions, evaluation rubrics, usage of project management tools, mapping performance of the students with the outcomes of the course and program, feedback from the stakeholders like companies and students themselves gives a clear view of improvement of the performance of the students during the Final Year Project course in three years.

Keywords – Project Based Learning, Final year project, Computer science and Engineering, Higher education.

To cite this article:

Deepamala, N., & Shobha, G. (2018). Effective approach in making capstone project a holistic learning experience to students of undergraduate computer science engineering program. Journal of Technology and Science Education, 8(4), 420-438. https://doi.org/10.3926/jotse.427

----------

1. 1. Introduction

Final year project (FYP) is where undergraduate students of engineering courses undertake a project work as a part of their final year academics. These projects can be of 2 types, they can be live projects carried out at an industry on one of the real time industry problems, or they can be in-house projects which are carried out within the department over one of the research topics in any subject. Every project is an extensive learning experience for the student and a platform to apply everything that he/she has learnt throughout the course. The importance of a final year project in the program is summed up in the following points:

a.Final year project is the only major course in a complete semester spanning for six months.
b.Final year project alone fetches 18 credits to a student.
c.Students carry out the project individually or in groups containing up to four students.
d.Students get an opportunity to execute live projects in the industry.
e.Programming Languages like C++, Java, Python etc., and subjects like Data Structures Computer Networks, Software Engineering and varied electives learnt in lower semesters are put into practical application.
f.FYP is one of the major criteria to calculate the outcome of the engineering program.

Over the delivery of the course in the previous years, many observations were made which needed modifications to increase the effectiveness of the course. Following are the observations that were modified for improvement from academic year 2014-15 onwards:

a.Rubrics for the projects were not exhaustive and required changes based on the attainment of outcomes.
b.Clearly defined course and program outcome was required to map the rubrics and feedback to evaluate the outcome and to improve the program.
c.Incorporation of continuous evaluation of project progress and emphasis on product development cycle (PDC) at each phase was necessary.
d.Students tended not to consider society, environment and interdisciplinary projects unless emphasized. Hence changes were to be made in the rubrics and training.
e.Conduction of workshops at different phases to motivate and train the students about synopsis writing, project management (Gantt chart), project design and effective report writing for the project was additionally planned.
f.Industry-academia relationship needed improvement which could be achieved by extensive feedback from the industry and the students.
g.Effective documentation and storage of project reports was essential for future reference.
h.Continuation of project titles for the next academic year was crucial for completion of long projects. If students have worked on a particular topic for first year, the next batch continues the work based on the scope for future developments in the topic.

2. Literature Review

Problem based learning and project based learning are two popular learning mechanisms in higher education. In problem based learning, students solve open ended problems to understand the concepts. On the other hand, project based learning is a learning mechanism where the course goes on for a specific duration with the outcome of a product or presentation with some analysis. Blumenfeld, Soloway, Marx, Krajcik, Guzdial and Palincsar (1991) explain how to motivate students to investigate and solve non-trivial problems, the difficulties faced in problem based learning and how they can be solved. The role of teachers and technology in motivating students, assessment of the project work and management of project are discussed. Mills and Treagust (2003) discuss the application of problem based and project based learning to engineering students. They stress on the importance of project based learning compared to “chalk and talk” method. Many institutions that incorporate traditionally taught courses mixed with project based components are reviewed and it is concluded that this method is readily accepted by students, industry and accreditors.

Bell brings out the importance of project based learning in the 21st century in Bell (2010). Learning responsibility, independence and discipline are the three important outcomes of project based learning. The author further discusses how project based learning enhances creativity, real world connections, collaboration skills and technology. Krajcik et al. discuss the steps in carrying out a project based learning process in detail (Krajcik & Blumenfeld, 2006). According to the authors, the key features in project based learning are driving questions, situated inquiry, collaboration, learning technologies and artifacts.

Engineering final year projects have been studied in detail in many papers. Ku and Goh (2010) emphasize that individual project were more effective in Europe and Australia. More students published papers in case of individual projects. Healey, Lannin, Stibbe and Derounian (2013) explain ways to enhance final year project and dissertation work. Stages and processes involved in final year project assessment in the University of Bath were discussed in Harris and Smith (1983).

Impact of program outcome, implementation and the factors that affect the outcome are discussed in Durlak and DuPre (2008) and Darling-Hammond (2006). Importance of rubrics and its effect on evaluation has been studied in detail in Stevens and Levi (2013). Outcome based evaluation and assessment of capstone project are discussed in Vijayalakshmi, Desai and Joshi (2013) and Dunlap (2005). The studies and suggestion in all these reference articles have been applied into the curriculum execution and results of these observations are discussed in this article.

3. Continuous Evaluation of the Project Work

A project work involves many tasks, beginning from the inception of a topic to the final submission of the dissertation. It is necessary to introduce a process of continuous evaluation of the project to ensure effective progress of the project work and its adherence to schedule. The student evaluation is carried out based on rubrics which are mapped to the course outcomes. Conduction and evaluation of the project is split into five phases. Each phase covers an important part of the Product Development Cycle (PDC). A committee is set up for the evaluation process. During the three academic years 2014-2017 the total number of projects is given below in Table 1.

Academic Year	Total Number of Project teams	Industry Live Projects		In-House Projects
Academic Year	Total Number of Project teams	Count	In percentage	Count	In percentage
2016-17	120	82	69%	38	31%
2015-16	89	66	75%	23	25%
2014-15	80	46	58%	34	42%

Table 1. Count of In-house and Industry projects

3.1. Project Committees for Evaluation

In Computer Science and Engineering, projects can be broadly classified as Computer Vision, Data Mining, Business Intelligence, Networking and Wireless Technologies. All the projects are largely classified into these domains. Committee members for evaluation are chosen from the faculty of Computer Science and Engineering department and also related departments like Information Science and Engineering and Mathematics. Evaluation is considered as part of academic work and academic workload units are assigned per week for the faculty who are committee members. This helps the faculty to dedicate time for students who require suggestions and feedback related to their projects. The projects are further divided into application, product and research, based on its type as shown in Table 2. The classification of projects helps the committee in evaluation. For example, more emphasis should be given to comparison of models than output in case of research projects.

Domain	2016-17
Domain	Application	Product	Research
Networking	15	5	2
Wireless Technologies	13	3	2
Data Mining	10	4	4
Business Intelligence	34	3	1
Computer Vision	8	2	14
Total	120
Domain	2015-16
Networking	7	6	6
Wireless Technologies	5	3	3
Data Mining	19		5
Business Intelligence	19		4
Computer Vision	4		8
Total	89
Domain	2014-15
Networking	13	2	5
Wireless Technologies	9	1	3
Data Mining	9		7
Business Intelligence	11	1	2
Computer Vision	5	1	11
Total	80

Table 2. Types of Projects with domains

3.2. Project Topic Collection and Dissemination

Project topics allocation is done in two ways. For in-house projects, the topics are collected from the faculty members and communicated to the students through group email in the previous semester. The students then make groups and select topics from the list. On the other hand, if the student opts for a live industry project, the industry assigns the topic to the students which they then communicate to the department. Once these processes are done, the students finalize their topics by submitting a topic finalization form and a synopsis.

After the finalization, these topics are evaluated by the committee for approval where the students submit their project synopsis. Approval of the topic by the committee is a necessity for further continuation of the project. Once the approval is initiated, guides are allocated to the individual students and student teams based on the topics and the subject expertise of the faculty in those topics.

3.3. Project Phases and Rubrics

Project Phases are related to Product Development Cycle (PDC). The phases and their main tasks are shown in the Figure 1.

Figure 1. Various steps in evaluation of Major Project

3.3.1. Phase 1

Phase 1 is the initial phase where the project teams will finalize their topics, submit a synopsis presenting the methodology, objectives and scope of the project. Rubrics are defined for the marks allocation. Contribution of the project towards the society, environment, interdiciplinary scope are considered during the evaluation. Further, a training session is organized for the students on the selection of a topic, during this phase.

Training 1: Workshop on “Selection of Project Topic”

This first training session is conducted at the beginning of the semester to explain the importance of taking projects related to society, environment and also motivate students to take up interdisciplinary projects. The topic of synopsis writing is also explained to the students in this session. Conduction of project work through phases, importance of project management, team structure, etc. are explained to the students. The students are also trained in the usage of tools like Gantt chart. The details of the rubrics for Phase 1 are listed below in Table 3.

3.3.2. Phase 2

The details of the rubrics of Phase 2 are listed in Table 4.

In Phase 2, the students present a detailed methodology of the project to the committee. If the committee believes that the methodology is not appropriate or there is a better way to conduct the experiments, the teams are advised about the changes. Emphasis is given on the study of literature and gaps in the research. Phase 2 also encourages the students to demonstrate project management skills in the form of project planning and team structure. Students present the project planning in the form of a Gantt chart, i.e. a pictorial representation of the project plan with milestones and the planned dates of completion of each milestone. Both the guide and the committee evaluate the presentation given by the project teams based on the rubrics. A sample of a Gantt chart is as shown in Figure 2.

		Excellent	Good	Satisfactory	Poor
a.	Identification of Problem in the Program Domain CO1	–Project Topic clearly defines the project work to be undertaken. –Problem statement is unique in the domain and has scope for research work and outcome in the form of publication, patent etc.	–Project Topic clearly defines the project work to be undertaken. –Problem statement is unique in the domain but has limited scope for research and outcome in the form of publication, patent etc.	–Project Topic is not clearly defined. –Uniqueness of the problem in the domain is not clearly justified.	–Problem statement not unique, need change of topic or modification in the problem definition.
b.	Existing Systems and Feasibility of Project Proposal CO1	–Justifies the project topic with a brief survey of the existing systems and their limitations with its business value.	–Justifies the project with a brief survey of existing systems without proper justification of their limitations and business value.	–Partial justification to the project topic with improper explanation of existing systems, their limitations and market value.	–Incomplete justification to the project topic with improper explanation of existing systems, their limitations and market value.
c.	Objectives and Methodology of the Proposed Work CO2	–All objectives of the proposed work are well defined and justified. –Steps to be followed in the form of methodology to solve the defined problem are clearly specified.	–Most of the objectives are defined and justified. –Methodology to be followed to solve the problem is mostly defined.	–-Incomplete justification to the objectives proposed. –-Steps mentioned in methodology are without justification to objectives.	–Only few objectives of the proposed work are well defined. –Methodology followed to solve the defined objectives is poorly defined.
d.	Knowledge, Skills, and Research Base leading to interdisciplinary project CO1	–Demonstrates deep understanding of the concepts and tools related to the project. –Interdisciplinary project with contribution from other domains is demonstrated as collaboration with other department students or teams in industry.	–Demonstrates deep understanding of the concepts and tools related to the project. –Not an interdisciplinary project but has notable contribution to the given domain.	–Partial understanding of the concepts related to the project and its scope. –Not an interdisciplinary project and limited contribution of the project to the domain.	–Minimally understands the concepts related to the project. –Not an interdisciplinary project and limited scope of the project in the given domain.
e.	Contribution to society and environment CO1	–Objective related to environment or society is mentioned in the project objective and is of higher significance.	–Objective related to environment and society is defined in the objective but is of lesser significance.	–No defined objective related to environment or society in the project work.

Table 3. Rubrics for Phase 1 with CO mapping

		Excellent	Good	Average	Acceptable
a.	Knowledge, Skills, and Research Base CO1	–Detailed study is made on existing systems and their limitations. –The surveyed papers are comprehensive to the problem and cover recent developments. –Demonstrates superior use and integration of theory, research, and best practices.	–-Elaborate survey of existing systems and their limitations. –-The surveyed papers are not comprehensive to the problem and do not cover recent developments. –Demonstrates high quality in use and integration of theory, research, and best practices.	–Moderate survey of existing systems and their limitations. –The surveyed papers are not satisfactory to justify the problem statement. –Demonstrates acceptable use and integration of theory, research, and best practices.	–Partial survey of existing systems and their limitations. –The surveyed papers are outdated and not relevant. –Demonstrates minimum use and integration of theory, research, and best practices.
b.	Design Methodology CO3	–Accurate division of problem into modules and good selection of computing framework. –Appropriate Design methodology with justification.	–Accurate division of problem into modules but improper selection of computing framework. –Design methodology is not properly justified.	–Division of problem into modules correct but Inappropriate selection of computing framework. –Design –Methodology not defined properly.	–Partial division of problem Into modules and inappropriate Selection of computing framework. –Design Methodology not defined properly.
c.	Planning of Project Work and Team Structure CO3	–Project schedule properly specified as Gantt chart in detail. –Appropriate distribution of project work among team members.	–Project schedule properly specified as Gantt chart. –Inappropriate distribution of project work among team members.	–Project schedule not planned properly. –Distribution of project work un-even among team members.	–Project schedule improperly specified. –Un-even distribution of project work and no synchronization.

Table 4. Rubrics for Phase 2 with CO mapping

Figure 2. An example of a Gantt chart

3.3.3. Phase 3

Phase 3 is the design phase where the students present a high level design and a detailed design of the project with the help of Data Flow Diagrams (DFDs), structure charts, flow charts and module descriptions. The committee evaluates the design and gives a feedback about it. Suggested changes, if any, are incorporated at this stage. Both the guide and the committee evaluate the work presented based on the rubrics. These rubrics are listed in Table 5.

		Excellent	Good	Average	Acceptable
a.	Incorporation of suggestions	–Changes are made as per modification suggested during evaluation of phase 2 and new innovations added.	–Changes are made as per modifications suggested during evaluation of phase 2 with good justification.	–All major changes are incorporated as per the modifications suggested during evaluation of phase 2.	–Few changes are made as per modifications suggested during evaluation of phase 2.
b.	High Level Design CO3	–Design of system according to appropriate architectural model and design adhere to objectives specified. –Superior representation of project design in the form of DFDs, Use case diagrams and structure charts.	–Design as per architectural model but not clearly demonstrated. All the objectives are not covered. –- Good representation of project design in the form of DFDs, Use case diagrams and structure charts.	–Partially objectives are covered in the design. –Partial representation of project design in the form of DFDs, Use case diagrams and structure charts.	–Partially objectives are covered in the design. –Incorrect representation of project design in the form of DFDs, Use case diagrams and structure charts.
c.	Detailed Design CO3	–Well-designed module level functional description and understanding of computing principles and algorithms.	–Well-designed module level functional description and understanding of computing principles and algorithms but not clearly demonstrated.	–Well-designed module Level functional description and partial understanding of computing principles and algorithms.	–Partially designed module Level functional description and partial understanding of computing principles and algorithms.
d.	Partial Implementation CO3	–Implementation is efficient using latest tools and technology. –Implementation is modular and/or reusable with appropriate programming language.	–Implementation is partially efficient using latest tools and technology. –Implementation is modular and/or reusable with appropriate programming language.	–Implementation is partially efficient. –Missing modular programming and wrong choice of programming language.

Table 5. Rubrics for Phase 3 with CO mapping

Training 2: Workshop on Writing Design Document

A second training session is conducted in the middle of the semester to explain the importance and method of designing a product. Importance of Data Flow Diagrams (DFD), structure charts, UML diagrams, flow charts, etc. are explained to the students. Open source tools like ProjectLibre (Tsvetkov, 2015) for project management, GIthub (https://github.com /) for project sharing and starUML (StarUML, U.M.L., 2005) for drawing diagrams are introduced. Software design is already learnt in software engineering subjects in lower semesters, but students usually find it difficult to apply the concepts to real-time project. Correct representation of modules in the project in the form of diagrams and depiction of control and data flow requires training and feedback from the faculty.

3.3.4. Phase 4

In Phase 4, the project teams demonstrate the complete implementation of the modules, unit testing and integration testing with relevant result analyses. Students present the implementation of the project to the committee with the results of the testing. If any modifications are required in the implementation, students are given a week time to make these modifications. Students show a demo of their project during the presentation. Both the guide and committee members evaluate the work carried out by the students based on rubrics. These rubrics are listed in Table 6.

		Excellent	Good	Average	Acceptable
a.	Implementation CO3	–The implementation consistent with design, coding standards and optimized. Clear and understandable description of the functional status of each features or modules. –All algorithms are clearly defined with correct representation.	–The implementation consistent with design, understandable but not clearly defined. –Algorithms are defined with correct representations.	–The implementation consistent with design, most of the functional status of features not understandable. –Algorithms are partially represented.	–Implement deviated from design, no coding standards and partially understandable. –Improper description of algorithms and representation.
b.	Testing CO3	–Exhaustive coverage of all test cases related to system testing, unit testing and Integration testing. –Dataset, Evaluation mechanism are clearly mentioned. –Test plan clearly shows testing assumptions, constraints and test results.	–Most of the test cases related to system testing, unit testing and Integration testing are covered. –Dataset, Evaluation mechanism are clearly mentioned. –Test plan clearly shows testing assumptions, constraints and test results.	–Partial coverage of test cases related to system testing, unit testing and Integration testing. –Dataset, Evaluation mechanism are not clearly mentioned. –Test plan partially shows testing assumptions, constraints and test results.	–Incomplete coverage of test cases related to system testing, unit testing and Integration testing. –Dataset, Evaluation mechanism are not clearly mentioned. –Test plans partially shows testing assumptions, constraints and test results.
c.	Experimental Result and analysis CO3	–The findings logically map with the design. –Appropriate statistical analyses/graphs used and results correctly interpreted.	–The findings partially logically map with the design. –Appropriate statistical analyses/graphs used and results partially interpreted.	–The findings partially logically map with the design. –Not Appropriate statistical analyses/graphs used and results are partially interpreted.	–The findings does not logically map with the design. –Incorrect statistical analyses/graphs used and results are incorrect.
d.	Conclusion and Future work CO4	–The conclusion effectively summarizes the results and important ideas without sounding repetitive or redundant. –The future work concludes with thought provoking details.	–The conclusion partially summarizes the results and important ideas without sounding repetitive or redundant. –The future work concludes with thought provoking details.	–The conclusion does not summarize the results and important ideas without sounding repetitive or redundant. –The future work does not conclude with thought provoking details.
e.	Demo of the project CO4	–Demo shown and complete.	–Demo shown but incomplete.	–Demo shown but with mistakes.	–No demo shown.

Table 6. Rubrics for Phase 4 with CO mapping

3.3.5. Phase 5

Phase 5 is the final phase, where the students document the project in the form of a project dissertation report. The student has to get the report verified by the guide initially and later by the committee. Finally, the project report with all the modifications completed, is checked for plagiarism and submitted to the department to be stored in the department library. These project dissertation reports are maintained in the department library for any future reference for the faculty and students. The rubrics for Phase 5 are listed in Table 7.

		Excellent	Good	Average	Acceptable
a.	Completeness of the report CO4	–The report is clear, concise and understandable. –Technical dependency, theory and observation clearly stated.	–The report is clear, concise and understandable. –Technical dependency, theory and observation are not clearly stated.	–The report is partially clear, concise and understandable. –Technical dependency, theory and observation not clearly stated.	–The report is unclear, not concise and not understandable. –Technical dependency, theory and observation are not accurate.
b.	Format and aesthetics CO4	–Report is well organized and formatted. –References are according to IEEE publication standards.	–Report is not well organized and formatted. –References are not according to IEEE publication standards.
c.	Figures and Tables CO4	–The figures and tables are complete, detailed and formatted.	–Figures are not clear but tables partially formatted and detailed.	–Figures and tables are partially complete, detailed and formatted.	–Improper representation of figures and tables.
d.	Ethics CO4	–Report is plagiarism checked and acceptable. –All the instructions related to project given throughout the semester were followed.	–Report is plagiarism checked and acceptable. –Instructions given throughout the project course were partially followed.

Table 7. Rubrics for Phase 5 with CO mapping

Training 3: Workshop on Report Writing

A final workshop is conducted at the end of Phase 4 to explain the importance of documentation and the procedure to write a good project dissertation report. Importance of plagiarism check and documentation ethics are also explained to the students.

4. Program and Course Outcomes

Computer Science and Engineering is a program of undergraduate studies in engineering. This program consists of courses that are spread across multiple semesters. The outcomes of the program and its involved courses are the metrics necessary in quantifying the learning of the student. A program outcome depends on course outcomes. Final year capstone project as a course, is a major contributor to the achievement of the program outcomes.

Program outcomes are defined as per the graduate attributes which adhere to Outcome based Education of Washington Accord. These are important criteria in the accreditation process of the institution. The program outcomes defined in the accord for Computer Science and Engineering are as listed below:

•PO1: Engineering Knowledge
•PO2: Problem Analysis
•PO3: Design/Development of solutions
•PO4: Conduct Investigations of Complex Problems
•PO5: Modern Tool Usage
•PO6: The Engineer and Society
•PO7: Environment and Sustainability
•PO8: Ethics
•PO9: Individual and Team Work
•PO10: Communication
•PO11: Project Management and Finance
•PO12: Life-long learning

The outcome of the course, final year project (FYP) is calculated by mapping the rubrics to the course outcomes. The course outcomes for final year project are defined as:

•CO1: Perform literature review; identify state of the art in technology and research in that field and use the literature study define the problem.
•CO2: Establish a methodology using advanced tools / techniques for solving the problem including project management and finances.
•CO3: Design, develop analytical models, perform numerical analysis and interpret the results
•CO4: Prepare quality document of project work for publications, patenting and final thesis.

The presentation given by each team in all the phases is evaluated by the committee and the guide. The final marks of each phase are calculated by taking 50% of the total marks from the committee and 50% from the guide marks. The evaluation structure and marks are as shown in Figure 3.

Figure 3. Evaluation of the Project by the Committee

5. Attainment of Course and Program Outcomes

5.1. Attainment of Course Outcome Based on Rubrics

Rubrics of all the phases conducted throughout the course are mapped to the course outcomes. The assigned marks by the committee and guide are tabulated and attainment of course outcome is calculated as follows:

Where COi is the course outcome ranging from 1 to 4. The course outcomes attained by all the students are averaged to calculate the cumulative course outcome of the course. Figure 4 shows the course outcome attained percentage for the final year projects for three years during the academic year 2014-15 to 2016-17.

Figure 4. Course Outcome attained percentage for three years

5.2. Attainment of Program Outcome Based on Course Outcome and Action Taken

Program outcome is calculated from course outcome as follows.

Course Outcomes (COi) of the courses are mapped to Program Outcomes (PO) by assigning a weightage based on relevance on a scale of low (1), medium (2) and high (3) as shown in Table 8. The weightage is based on the extent to which the outcome is delivered in the form of teaching, training, incorporation in rubrics etc.

Cos

PO1

PO2

PO3

PO4

PO5

PO6

PO7

PO8

PO9

PO10

PO11

PO12

CO1

CO2

CO3

CO4

Table 8. The CO-PO weightage mapping for the year 2014-15 and 2015-16

where H is high, M is medium and L is low.

The PO attainment of final year project course =

Where wi is weightage in the range (1, 2, and 3) allocated to COi. Denominator is course outcome multiplied by maximum value three or high.

Consider the course outcome for two academic years 2014-15 and 2015-16 as given in Table 9 or Figure 4.

	CO1	CO2	CO3	CO4
2015-16	66	66	71	69
2014-15	79	77	76	78

Table 9. CO attainment for the years 2014-15 and 2015-16

Program outcome for the year 2014-15 and 2015-16 is as shown in Table 10.

For example, for the year 2014-15, PO1 is calculated as follows:

From Table 8, CO-PO weightage for PO1 is (3,3,1) and CO attainment is (79,77,76,78). Therefore from the above formula,

POs	PO1	PO2	PO3	PO4	PO5	PO6	PO7	PO8	PO9	PO10	PO11	PO12
2015-16	83	83	83	83	58.2	33.3	33.3	66.6	33.3	33.3	58.2	58.2
2014-15	83.2	83.2	83.2	83.2	58.2	33.3	33.3	66.6	33.3	33.3	58.2	58.2

Table 10. Program Outcomes for the years 2014-15 and 2015-16

Since no changes were made in 2014-15 and 2015-16, the attainment remained constant. For the academic year 2016-17, changes were made as shown in Table 11.

PO6 Engineer and Society	Projects related to society were given importance by adding it in the rubrics and motivating students to take up topics related to society. Hence the relevance mapping is also increased from Low (1) to Medium (2).
PO7 Environment and sustainability	Projects related to environment were given importance by adding it in the rubrics and motivating students to take up projects related to environment. Hence the relevance mapping is also increased from Low (1) to Medium (2).
PO8 Ethics	Explaining students about the importance of plagiarism check and made it mandatory by including it in the rubrics. Hence PO8 was increased from Medium (2) to High (3).
PO9 Individual and Team work	Students were motivated to take up interdisciplinary projects and team structure was made mandatory by including in the rubrics. Hence the relevance of PO9 was increased from Low (1) to Medium (2).
PO10 Project management and Finance	Project management was made mandatory by motivating students to plan finance and project scheduling using Gantt chart and was added in rubrics for evaluation. Hence relevance was raised from Low (1) to Medium (2).

Table 11. Action taken for the academic year 2016-17

The CO-PO weightage mapping for the year 2016-17 based on action taken is as given Table 12.

Cos

PO1

PO2

PO3

PO4

PO5

PO6

PO7

PO8

PO9

PO10

PO11

PO12

CO1

CO2

CO3

CO4

Table 12. CO-PO weightage mapping for academic year 2016-17

Course outcome and Program outcome calculated from the Table 12 for the year 2016-17 is given in Table 13 and Table 14.

	CO1	CO2	CO3	CO4
2016-17	87	86	89	89

Table 13. Course outcome for the year 2016-17

POs	PO1	PO2	PO3	PO4	PO5	PO6	PO7	PO8	PO9	PO10	PO11	PO12
2016-17	83	83	83	83	58.2	66.6	66.6	100	66.6	66.6	58.2	58.2

Table 14. Program Outcome for the year 2016-17

It can be observed that after action taken, the attainment of PO6 to PO10 in academic year 2016-17 has improved.

5.3. Industry Feedback for Industry Projects

Feedback is collected from the industry supervisors of the students who undertake live projects in industry. This feedback helps in calculation of attainment of program outcome. A feedback form is collected from companies which contains questions mapped to the program outcomes as shown below in Table 15.

Sl. No.	Parameters	PO	Please Tick the appropriate grade
1	Ability to apply mathematical concepts wherever required.	PO1	Excellent (10)
			Very Good (8)
			Good (6)
			Satisfactory (4)
			Poor (2)
2	Understanding of computer science concepts, theories and Programming languages.	PO2	Excellent (10)
			Very Good (8)
			Good (6)
			Satisfactory (4)
			Poor (2)
3	Ability to apply skills learnt, analyze the problem and find efficient solutions and tools.	PO3, PO5	Excellent (10)
			Very Good (8)
			Good (6)
			Satisfactory (4)
			Poor (2)
4	Problem Solving and critical thinking skills	PO4	Excellent (10)
			Very Good (8)
			Good (6)
			Satisfactory (4)
			Poor (2)
5	Ability to work in a team	PO9	Excellent (10)
			Very Good (8)
			Good (6)
			Satisfactory (4)
			Poor (2)
6	Approach towards Environment and sustainability, society and safety by the student.	PO7, PO6	Excellent (10)
			Very Good (8)
			Good (6)
			Satisfactory (4)
			Poor (2)
7	Professional ethics and responsibilities demonstrated by the student.	PO8	Excellent (10)
			Very Good (8)
			Good (6)
			Satisfactory (4)
			Poor (2)
8	Project management and finance skills	PO11	Excellent (10)
			Very Good (8)
			Good (6)
			Satisfactory (4)
			Poor (2)
9	Communication skills	PO10	Excellent (10)
			Very Good (8)
			Good (6)
			Satisfactory (4)
			Poor (2)
10	Ability to engage in independent and changing technology skill upgradation.	PO12	Excellent (10)
			Very Good (8)
			Good (6)
			Satisfactory (4)
			Poor (2)

Table 15. Feedback questions mapped to POs

The feedback questions are mapped to program outcomes and are tabulated to calculate the attainment of PO. Industries are major stakeholders in the program. The outcome of program from feedback is calculated as:

Where POi are the Program outcomes ranging from 1 to 12.

The comparison of percentage of program outcome attained based on feedback from the industry is shown in Figure 5.

Figure 5. Program Outcome attained percentage based on Industry feedback

It can be observed that there is improvement in two years compared to attainment in 2014-15.

5.4. Student Feedback About the Course

An exit survey is conducted for the students after completion of the final year project course. The feedback questions are mapped to program outcomes and are tabulated to calculate the attainment of PO.

Where POi are the Program outcomes ranging from 1 to 12.

The average of program outcomes attained by all the students gives the overall attainment of PO for the program. The percentage of program outcome, attained based on feedback, for the year 2016-17 is as shown in the Figure 6.

Figure 6. Program Outcome attained percentage based on Student feedback for the year 2016-17

6. Continuation of Projects

Some complex projects are carried out for multiple academic years as in-house projects. These help in establishing an in-depth knowledge on the topic and create a prototype. An open source tool such as GitHub is used to maintain and update the source code across student batches. Faculty who guide such projects can publish or apply for project funding. Some examples of such projects are as shown in Table 16.

Sl. No.	Year	Topic	Type of project
1	2015-16	Contextually Recommended Searching of Unstructured Data using Machine Learning Techniques	Research work
1	2016-17	Intellisearch: a search engine based on context based search and retrieval of unstructured data.	Application
2.	2015-16	Object Counting In Video Sequences	Research Work
2.	2016-17	Object tracking with occlusion handling in videos	Research work and Application
3	2015-16	Preprocessing and Segmentation of Historical Records	Research work
4	2016-17	Restoration and classification of historical records	Research Work

Table 16. Projects continued for two years

7. Publications and Recognitions

7.1. Project Magazine

After the final evaluation of the projects, a magazine called “Technonest” is published every year and preserved for future reference in the library. The magazine consists of project title, student names, guide names, industry details and the abstracts of the projects. The cover page of the magazine for the year 2016-17 is shown in Figure 7. Future students who are looking for related projects can go through the magazine to find them and the project reports of the related projects can be retrieved from the library.

Figure 7. Collection of Abstracts “Technonest” magazine

7.2. Best Project Prizes

A system of appreciation for the best project is put in place to provide motivation. During phase 4, the committee recommends projects in that domain for best project evaluation. Evaluation of the best project is conducted for all these listed projects with industry experts as judges. Shortlisted projects are presented and demonstrated by the students. The judges then select three best projects among the shortlisted projects and these teams are awarded with prizes and certificates.

8. Observations

The observations made after completion of final year project course from 2014-15 to 2016-17 are as follows:

1.Continuous evaluation of the course is achieved through phases and rubrics. Rubrics help in effective evaluation of the final year project.
2.Program outcome is evaluated based on course outcome and feedback from the industry and students. The program outcome has increased in 2016-17 and this is because of the observations made in the previous year and actions taken upon them.
3.Industry relationship with the academia is enhanced by taking feedback from the industry and improving on the places of lacuna. Improved program outcome is observed in the academic year 2016-17 based on feedback from industry. Furthermore, the number of industry projects has increased over the years.
4.Student feedback for the year 2016-17 shows that the students are satisfied with the conduction and evaluation of the course with an average of 88% program outcome attained.
5.Continuation of the project work by juniors helps the students and guides to go in-depth of the topic and to create a prototype, which helps the guide to apply for further funding from agencies.

9. Conclusion

Final year project is a very important course in Computer Science and Engineering undergraduate program. The course tests the student for his readiness to enter the corporate world. It also provides an exposure to, conducting research, effective documentation, project management and planning. The evaluation procedure discussed brings out the importance of rubrics for continuous evaluation and attainment of the course and program outcomes. The program can be improved through observations and actions taken based on attainment of outcomes. Therefore, this paper gives a holistic approach to the learning experience of student through capstone project.

Declaration of Conflicting Interests

The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Funding

The authors received no financial support for the research, authorship, and/or publication of this article.

References

Bell, S. (2010). Project-based learning for the 21st century: Skills for the future. The Clearing House, 83(2), 39-43. https://doi.org/10.1080/00098650903505415

Blumenfeld, P.C., Soloway, E., Marx, R.W., Krajcik, J.S., Guzdial, M., & Palincsar, A. (1991). Motivating project-based learning: Sustaining the doing, supporting the learning. Educational Psychologist, 26(3-4), 369‑398. https://doi.org/10.1080/00461520.1991.9653139

Darling-Hammond, L. (2006). Assessing teacher education: The usefulness of multiple measures for assessing program outcomes. Journal of Teacher Education, 57(2), 120-138. https://doi.org/10.1177/0022487105283796

Dunlap, J.C. (2005). Problem-based learning and self-efficacy: How a capstone course prepares students for a profession. Educational Technology Research and Development, 53(1), 65-83. https://doi.org/10.1007/BF02504858

Durlak, J.A., & DuPre, E.P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41(3-4), 327-350. https://doi.org/10.1007/s10464-008-9165-0

Harris, D., & Smith, B. (1983). Undergraduate project work. Assessment and Evaluation in Higher Education, 8(3), 246-261. https://doi.org/10.1080/0260293830080307

Healey, M., Lannin, L., Stibbe, A., & Derounian, J. (2013). Developing and enhancing undergraduate final‑year projects and dissertations. York: Higher Education Academy.

https://github.com/ (Accessed: May 2018).

Krajcik, J., & Blumenfeld, P. (2006). Project-Based Learning. In Sawyer, R. (Ed.), The Cambridge Handbook of the Learning Sciences (Cambridge Handbooks in Psychology, 317-334). Cambridge: Cambridge University Press.

Ku, H., & Goh, S. (2010). Final year engineering projects in Australia and Europe. European Journal of Engineering Education, 35(2), 161-173. https://doi.org/10.1080/03043790903497336

Mills, J.E., & Treagust, D.F. (2003). Engineering education—Is problem-based or project-based learning the answer. Australasian Journal of Engineering Education, 3(2), 2-16.

StarUML, U.M.L. (2005). Modeling tool. Multilingual project. Version 5.0. 2.1570.

Stevens, D.D., & Levi, A.J. (2013). Introduction to rubrics: An assessment tool to save grading time, convey effective feedback, and promote student learning. Stylus Publishing.

Tsvetkov, K. (2015). Project management by application of open source software ProjectLibre. 978-619.

Vijayalakshmi, M., Desai, P.D., & Joshi, G.H. (2013). Outcome based education performance evaluation of capstone project using assessment rubrics and matrix. Innovation and Technology in Education (MITE), 2013 IEEE International Conference in MOOC. IEEE. https://doi.org/10.1109/MITE.2013.6756295

This work is licensed under a Creative Commons Attribution 4.0 International License

Journal of Technology and Science Education, 2011-2024

Online ISSN: 2013-6374; Print ISSN: 2014-5349; DL: B-2000-2012

Publisher: OmniaScience

user
pwd
Remember me