E-CONTENT MODULE FOR CHEMISTRY MASSIVE OPEN ONLINE COURSE (MOOC): DEVELOPMENT AND STUDENTS’ PERCEPTIONS

This study aimed to develop an e-content module for Chemistry Massive Open Online Course (MOOC). It examined the validity, reliability and student’s perceptions on content, usability, design and effectiveness of the module. This is a design and development study and the e-content module was developed based on ADDIE instructional design model. Collaborative learning, Connectivism theory and Interaction Equivalency Theorem are the pillars for the module development. The content validity of the module was estimated by three experts using content validity evaluation form. Questionnaires were distributed to the students in order to determine the reliability (n = 23) and students’ perceptions on the module (n = 129). Findings revealed the e-content module has high content validity (CVI = 1.00) and good reliability index (α = 0.94). The mean scores for students’ perception on module content (M = 3.66, SD = 0.55), usability (M = 3.43, SD = 0.56), design (M = 3.41, SD = 0.59) and effectiveness (M = 3.47, SD = 0.56) constructs were high. This e-content module in Chemistry MOOC is hoped to be a good and useful online resource for both lecturers and students in the teaching and learning of Chemistry in higher education institution.


Background of Study
In line with the ninth shift of Malaysia Education Blueprint 2015-2025 (Higher Education), Malaysia's Higher Education Institutions (HEIs) are recommended to globalize online learning ( Figure 1). The shift was aimed to widen access to good quality content, improve the quality of teaching and learning, enhance online learning and highlight HEIs in international arena as well as nurturing lifelong learning specifically among Malaysians. The approaches proposed in the blueprint can be achieved through the offering of MOOCs in every HEI in Malaysia (Ministry of Education Malaysia, 2012).
Malaysia National e-Learning Policy (Dasar e-Pembelajaran Negara, DePAN) was enacted in 2011 to support National Higher Education Strategic Plan (Pelan Strategik Pengajian Tinggi Negara, PSPTN), where it focuses on the development of a quality e-learning framework. It aims to develop world-class human capital by using information and communication technologies. DePAN has five main pillars: (1) infrastructure, (2) organisational structure, (3) curriculum and e-content, (4) professional development and (5) acculturation (Ahmad, Hashim, Karimi & Sin, 2010). Each pillar has specific focus area and activities to be implemented in three implementation phases: initial phase (2011)(2012), implementation phase (2013)(2014), and optimum phase (2015 upwards). . Some milestones to be achieved by online pedagogies in the three phases are shown in Table 2.
E-Learning in HEIs refers to a technology that enhances teaching and learning in an educational institution (Nichols & Anderson, 2005). The use of e-learning software and hardware would create a more interactive, flexible and sophisticated teaching and learning environment. In Malaysia, most universities use their own e-learning system either the licensed open-source software or Learning Management System (LMS) which is equipped with a wide range of distinctive features that could facilitate online teaching and learning process.  (First MOOC, 2013;OpenLearning Global, 2014). Taylor's University offers their MOOC on openlearning.com. and it was announced to be the official online platform for Malaysia MOOCs. Since then, Malaysian Ministry of Education has commenced the implementation of MOOC in collaboration with four public universities in Malaysia as MOOC content developers. As a result, four MOOCs were first launched in openlearning.com. However, some HEIs faced some problems where their e-content is not getting the desired responses from lecturers and students compared to the traditional method (Ghani, 2012). In addition, Embi, Nordin, Husin and Hamat (2010) expressed the major challenges faced by the lecturers to integrate e-content in the teaching and learning sessions is balancing teaching with research and time constraints.
The milestone for the Phase 2 Domain 3: Online Pedagogies is each HEI offers a minimum of 15 MOOCs, however, statistics in 2018 showed most of the HEIs in Malaysia was not achieving that target (Hamid, 2020). Furthermore, statistics also showed that Chemistry MOOC in openlearning.com is still very low. Hence, Chemistry MOOC which consists of two types of modules i.e. e-content module and e-assessment module should be developed. The development of e-content module for this Chemistry MOOC provides guidance to lecturers to develop other MOOC. In addition, it also assists lecturers to facilitate the teaching and learning process in blended learning or flipped classroom. This study is implemented to design and develop e-content module for Chemistry MOOC in this regard.

Research Objectives
In general, this study aims to develop e-content module for Chemistry MOOC. Therefore, the objectives of this study are as follows: 1. Develop an e-content module for Chemistry MOOC using the ADDIE Model.
2. Estimate the content validity of the e-content module for Chemistry MOOC.
3. Estimate the reliability of the e-content module for Chemistry MOOC.
4. Identify students' perceptions in terms of content, usability, design and effectiveness of e-content module for Chemistry MOOC.

Conceptual Framework
The focus of this study is to develop the e-content module for Chemistry MOOC. ADDIE model was chosen as the instructional design model for the development of this Chemistry MOOC. During the analysis phase, four topics were selected as the content of this MOOC, namely Nuclear Chemistry, Quantum Theory and Periodic Table, Chemical Bonding and Stoichiometry of Formulas and Equations. Learning theories were studied and applied when the content of the MOOC is being designed. The theories involved are Collaborative Learning, Connectivism Theory and Interaction Equivalency Theorem. During the implementation phase, the Chemistry MOOC were introduced to three experts to check the content validity of the module. The reliability of the module was investigated during pilot study. Finally, perceptions of students on the module's content, usability, design and effectiveness were studied during the evaluation phase. Conceptual framework of the study is represented in Figure 2.  (Hamid, 2020) 2. Methodology

Research Design
This study is a design and development research to design and develop e-content module for Chemistry MOOC. This study also involves assessment studies aimed at estimating the validity, reliability and students' perceptions on the e-content module developed for Chemistry MOOC.

Respondents
This study involves the sampling of experts to evaluate the content validity of the module, sampling of students to access the reliability of the module and students' perceptions on the module. The purposive sampling technique was used to select the experts based on their knowledge in particular field or respondent wishing to be studied (Yahaya, Hashim, Ramli, Boon & Hamdan, 2007). In this study, three experts were selected to evaluate the validity of the e-content module for Chemistry MOOC.
To estimate the reliability of the module, a total of 23 students in semester three were selected to answer the module reliability questionnaire. The semester three students have taken both Chemistry I (SKU3013) and Chemistry II (SKU3023) courses, hence they are eligible to evaluate the reliability of the e-content module designed for Chemistry course (SKU3063). The population of students under Bachelor of Education (Chemistry) program is approximately 190. According to Krejcie and Morgan (1970), the sample required is 127. By using cluster random sampling technique, five groups of students from each semester have been selected to answer the students' perception questionnaire. The total respondents involved in the evaluation phase is 129 students. The demographic information of the respondents involved in this study is shown in Table 3.  Table 3. Demographic information of respondents in the study (Hamid, 2020)

Instrument
Three instruments were involved in this study: the module content validity evaluation form, module reliability questionnaire and module perception questionnaire. The module content validity evaluation form consists of 49 items evaluating on the relevance of content presented to the learners (Polit & Beck, 2006) based on the four topics in the Chemistry MOOC. The reliability of the module was evaluated based on the activities done by the learners (Noah & Ahmad, 2005). A total of 72 items were asked and respondents need to answer the questionnaire based on 5-point Likert scale. The distribution of items in the module content validity evaluation form and module reliability questionnaire are shown in Table 4. The content validity of the module was analyzed by using Content Validity Index (CVI) (Polit & Beck, 2006). The reliability of the module was analyzed by using Cronbach's alpha index while the perceptions of module were analyzed by using mean and standard deviation. The perceptions of the e-content module were evaluated based on content, usability, design and effectiveness of e-content module for Chemistry MOOC. The items in the perception questionnaire were adapted from the previous study (Lee & Osman, 2012;Lee, 2013). The content validity of the perception questionnaire was checked by experts (CVI = 1.00) and the reliability index of the questionnaire is 0.94. The distribution of items in the perception questionnaire is shown in Table 5.  Table 5. Distribution of items in perception questionnaire (Hamid, 2020)

Module Development Procedure
The first objective of this study is to develop the e-content module for Chemistry MOOC. It was developed based on the ADDIE model, following the five phases in the ADDIE model: analysis, design, development, implementation and evaluation phase.

Analysis Phase
The analysis phase is an initial phase in a design and development study involving information in the context and environment to be studied (Siraj, Alias, DeWitt & Hussin, 2013). Need analysis needs to be carried out before the module is developed for identifying probable causes of problems (Branch, 2009) and take action to resolve existing problems (Reinbold, 2013). In this study, the analysis has been divided into two parts: assessment needs analysis and module requirements analysis (Low, 2014).
The assessment needs analysis was carried out to choose the appropriate titles to be developed in MOOC and suitable for online learning students. Chemistry course (SKU3063) consists of seven topics, namely Stoichiometry of Formulas and Equations, Gaseous and the Kinetics-Molecular Theory, Quantum Theory and Periodic Table, Chemical Bonding, Electrochemistry, Chemical Equilibrium and Nuclear Chemistry. An online questionnaire was distributed to the lecturers at the Department of Chemistry to choose the appropriate topics to be developed in the e-content module in Chemistry MOOC. The selection of topics is also based on students' problems and weaknesses in learning basic chemistry concepts.
The findings of need analysis found four of the seven topics in Chemistry course (SKU3063) received the highest percentage. The topics are Nuclear Chemistry (65%), Quantum Theory and Periodic Table (55%), Chemical Bonding (55%), and Stoichiometry of Formulas and Equations (45%) as shown in Figure 3. The results are paralleled with the result found in another need analysis carried out by Lee, Sharif and Rahim (2018) which reported university students were weak in Matters and Measurements, Periodic Relationship among the Elements, Stoichiometry and Chemical Reactions. Therefore, these four topics were chosen to be included in the e-content module for Chemistry MOOC.
Module requirement analysis was carried out to analyze the specification of the module based on the results of assessment needs analysis. Module requirement analysis identified the objectives of the module, target users, content of the module, learning theories and pedagogy involved in the delivery of content in the module. The objectives of developing this e-content module for Chemistry MOOC is to create online learning materials for basic chemistry concepts in Chemistry course (SKU3063) to enable students to access the material regardless of time and geographical constraints. Lecturers can use this e-content module as one of the resources for their blended learning or flipped classroom platform. On the other hand, students can use this module as self-paced material to learn basic chemistry concepts. Hence, the target users of this econtent module are lecturers and students who wish to teach or learn basic chemistry concepts at university level especially those who enroll for the SKU3063 Chemistry course.
Based on the results of need analysis, four topics had been included in the course: Nuclear Chemistry, Quantum Theory and Periodic Table, Chemical Bonding, and Stoichiometry of Formulas and Equations. The structure of the topics is shown in Figure 4. Since the module was part of the Chemistry MOOC and is implemented online, the learning theories and pedagogy employed should be aligned with the characteristics of e-learning.
Students could access the e-content module individually either synchronously or asynchronously in Chemistry MOOC. Lecturers post questions or problems in the Chemistry MOOC ( Figure 5), and students share knowledge, discuss and work together to solve the problems ( Figure 6). Hence, e-learning environment encourage students to learn and share through collaboration (Baser, Ozden, & Karaarslan, 2017;Duke, Harper & Johnston, 2013). This collaborative learning enables students to help each other and achieve the intellectual, social and problem solving learning goals in the classroom (Baharin & Yusop, 2011).
Two learning theories: Connectivism Theory and Interaction Equivalency Theorem which are closely related to online learning environment were applied in the design and development of e-content module.
Connectivism is the integration of principles explored by chaos, network and complexity and self-organization theories (Siemens, 2005). It offers specific technological opportunities for users to be actively engaged in the presentation of a body of knowledge (Duke et al., 2013). This engaged learning requires collaborations among the community in the e-learning environment (Conrad & Donaldson, 2004). Hence, connectivism is also defined as actionable knowledge (Duke et al., 2013) because the learners need to find the related knowledge in the e-learning platform.  (Anderson & Garrison, 1998) Community in the Chemistry MOOC consists of students, lecturers and content of the e-content module. Each party in the community is involved and connected to each other in the teaching and learning process. The mode of interactions in the Chemistry MOOC are student-student, student-teacher, student-content, teacher-teacher, teacher-content and content-content (Figure 7). These interactions were described by Anderson and Garrison (1998) as Interaction Equivalency Theorem.
Two theses were proposed from the Interaction Equivalency Theorem as follows (Anderson, 2003: page 4).
Deep and meaningful formal learning is supported as long as one of the three forms of interaction (student-teacher; student-student; student-content) is at a high level. The other two may be offered at minimal levels, or even eliminated, without degrading the educational experience.
High levels of more than one of these three modes will likely provide a more satisfying educational experience, though these experiences may not be as cost or time effective as less interactive learning sequences.
Both theses illustrate the Interaction Equivalency Theorem in terms of quality and quantity. The first thesis focuses on the quality of interaction. If one of the interactions is conducted in quality, deep and meaningful learning is possible. In contrast, the second thesis focuses on the quantity of interactions. The thesis suggests that all three parties (teachers, students and content) need to interact regularly to ensure that learning is meaningful.

Design Phase
The design phase is started after the analysis phase. Before designing, specifications of the module requirements that have been identified in the analysis phase needed to be checked again. This is important to ensure the design of e-content module for Chemistry MOOC is based on specification of module that has been planned in the analysis phase. In this phase, specifications of the module's requirements may still be modified or corrected if there is any disadvantage to ensure that it is complete, and no modification should be made during the development phase. This phase is mainly focuses on the design of module's content.
The e-content module for Chemistry MOOC is divided into three main components, (1) learning outcomes and advance organizer, (2) learning material and (3) exercises. Storyboard (Figure 8) was used as a guidance in designing the content of the module based on the proforma (document stating the synopsis, learning outcomes and structure of the course) of the Chemistry course (SKU3063). Learning outcomes list all objectives needed to be achieved by students at the end of each topic while advance organizer provides the overview of each topic (Figure 9). Learning outcomes and advance organizer serve as outline for each topic in the e-content module. This outline helps learners to develop better strategies to achieve their learning goals and finally succeed in MOOC learning (Handoko, Gronseth, McNeil, Bonk & Robin, 2019).  (2016) and Silberberg (2013) and notes from the other two basic chemistry courses (SKU3013 and SKU3023). Videos ( Figure 11) related to the topics were downloaded from YouTube with duration of not more than 12 minutes. It is reported the best duration of online videos is six minutes in order to attract and sustain students' attention and ensure their engagement to the videos (Guo, Kim & Rubin, 2014;Lagerstrom, Johanes & Ponsukcharoen, 2015). A list of URL links for all videos downloaded from YouTube is enclosed at the end of each topic in the e-content module as an acknowledgement to the owners of the videos. Hence, it is considered as fair use of copyright in online education (Ministry of Education Malaysia, 2014).
Exercises are provided via the discussion page at the end of each topic ( Figure 5) and they are open for discussion. Students could share their answers in the space provided ( Figure 6). Hence, students in the e-content module can work together to solve the problems collaboratively. Not too many questions are posted in the e-content module because there is an e-assessment module (Figure 12) in the Chemistry MOOC which is focusing on giving exercises to the students. Exercises in the discussion page serve as formative assessment to ensure students master the topic before moving to another topic. This discussion page enables students to use peer assessment to help students' self-monitoring (Zhu & Bonk, 2019).

Development Phase
The development phase in this study is a phase that determines the tools and process of creating the e-content module in Chemistry MOOC. This phase was initiated after the design phase had fulfilled the specifications set in the analysis phase. This phase involves the process of generating materials needed to achieve the targeted objectives. The e-content module is part of material in Chemistry MOOC. We insert the title of the topic in the 'Add a New Module' box to create the title of the topic (Appendix 1.4).
During the Design phase, we have determined that there are three main components in each topic, namely (1) learning objectives and advance organizer, (2) learning material and (3) exercise. Hence, we need to develop these three components by adding page in the module. First step is developing the 'Learning Outcomes and Advance Organizer' page (Appendix 1.5). We need to click at the 'Edit page' button to develop the content in this page. In this e-content module, all the learning outcomes to be achieved by the students for each topic are presented in the form of videos. There are some widgets in the edit page interface. We need to click and drag the 'Video' widget to the right section of the screen to upload the video (Appendix 1.6). Videos can be uploaded by using URL or files saved in the computer.
We also can insert picture in the page. The Advance Organizer in each topic is presented in the form of picture. So, we can use the 'File' widget to upload the picture. Click and drag the 'File' widget to the right section of the screen and insert picture from the file saved in our computer (Appendix 1.7). After editing the 'Learning Outcomes and Advance Organizer' page, we add another page to create the content for the learning material. The first subtopic of 'Stoichiometry of Formulas and Equation' is 'The Mole'. We click at the 'Add a page' button and type the title of the subtopic in the box (Appendix 1.8).
Learning materials normally starts with notes in the form of PowerPoint slides. Hence, the 'File' widget is used to develop the content. Click and drag the 'File' widget to the right section of the screen and upload the PowerPoint slides saved in the computer (Appendix 1.9). The third component is the exercise. We need to use the 'Post file" widget to develop the Discussion page. Click and drag the 'Post file' widget to the right section of the screen. Next type the question in the setup part in 'Post file' widget (Appendix 1.10). Lastly, we need to test all links and navigation buttons in the e-content module to ensure all the navigations function well. Then we need to change the status of Chemistry MOOC from offline to online at 'General' interface from 'Course Setup' (Appendix 1.11). OpenLearning platform provides the URL so that we can share the Chemistry MOOC to others. The course promotional page ( Figure 13) will be displayed when the URL is typed in the online system.

Implementation Phase
During the implementation phase, the e-content module for Chemistry MOOC which has been developed in OpenLearning platform is now fully accessible to all users. In this phase, the validity and reliability of the module is estimated during the pilot study. According to Russell (1974), a module with good content validity should fulfil the following characteristics: a) meet the target population, b) satisfying situation for the implementation of the module, c) sufficient time for the learners to access the module, d) able to increase learner's achievement after using the module, e) able to improve learner's attitude after using the module.
Ahmad (2002) developed a content validity evaluation form which followed Russell's characteristics of good module. However, there were only five items in the evaluation form. Hence, content validity evaluation form in this study was developed by modifying the way of obtaining the content validity index of instrument (Polit & Beck, 2006). Three experts were assigned to evaluate the relevance of the material developed in the e-content module. They were briefed on how to use the Chemistry MOOC and were introduced with the e-content module in Chemistry MOOC. The content validity evaluation form was distributed to the experts and they were given two months to evaluate the content validity of the module. Russell (1974) stated the reliability of a module can be determined when the respondent is able to dominate the objectives and able to follow the steps for each activity in the module successfully. Hence, module reliability questionnaire had been developed following the sequence of activities provided in each topic in the e-content module in Chemistry MOOC. In this study, the respondents of the pilot study were students from Bachelor of Education (Chemistry) program who had taken Chemistry I (SKU3013) and Chemistry II (SKU3023) courses. The students were gathered and briefed on OpenLearning as well as how to use e-content module in Chemistry MOOC. They were given a month-long time to access the Chemistry MOOC and go through the learning process using the e-content module. After that, the respondents were asked to answer the reliability questionnaire. Upon completion of the implementation phase, the next phase is the evaluation phase.

Evaluation Phase
The evaluation phase of the ADDIE model is a continuous process in each phase in the development of e-content module for Chemistry MOOC. The aim of the evaluation phase is to assess the quality of the instructional products and processes, both before and after implementation (Branch, 2009). During this evaluation phase, the weaknesses and problems faced during the development of the e-content module are identified so that amendments could be made. The evaluation can be carried out in both formative and summative evaluation.
Formative evaluation is carried out to determine the potential effectiveness of learning resources under development and to identify any learning resources or parts thereof that need to be revised (Branch, 2009). It has been carried out concurrently with analysis, design, development and implementation phases in three typical ways, one-to-one trial, small group trial and field trial (Branch, 2009). Supervisor, all the research team members and experts were involved in checking and monitoring the process of designing and developing the e-content module. Supervisor checked the content in the mode of one-to-one trial, research team members and experts carried out the formative evaluation in small group trial and finally students in the pilot study access the e-content module in field trial. Comments and suggestions from the experts were taken into consideration and corrections were done after discussing with supervisor and research team members. Some of the issues raised up by the experts were related to the content and the use of instructional media. They also gave some ideas regarding the design of the learning material and they suggested us to create the reflection page (Figure 14) for the learners to reflect on what they have learnt in each topic and share their thoughts ( Figure 15). This is a useful strategy to facilitate students' metacognitive process in MOOCs by encouraging them to have self-reflection and self-monitoring (Zhu & Bonk, 2019). There are three levels of summative evaluation, level 1: perception, level 2: learning and level 3: performance (Branch, 2009). In this study, summative evaluation only involved level 1: perception. Level 1 evaluation measures students' perceptions of the course content, resources used, the physical classroom environment, or the ease of navigation in the virtual classroom environment and the teacher's facilitation style (Branch, 2009). In this study, students' perceptions in terms of content, usability, design and effectiveness of e-content module for Chemistry MOOC were studied. Perception questionnaire were developed by adapting instruments from Lee's study (2013). The findings of the students' perception on the e-content module will be discussed in the next section.

Results and Discussions
The first objective of this study is to develop the e-content module and the descriptions on developing the module were presented in the previous section. The second objective of this study is to identify the validity of the e-content module for Chemistry MOOC. Following the advice by Lynn (1986), three experts were appointed to evaluate the content validity of the e-content module for Chemistry MOOC. They were given two months to access the e-content module in Chemistry MOOC and evaluate the relevance of the content in the module. A 4-point scale (1 = not relevant, 2 = somewhat relevant, 3 = quite relevant, 4 = highly relevant) as recommended by Davis (1992) was applied in the content validity evaluation form in this study to avoid having ambivalent midpoint (Lynn, 1986). The experts checked each topic and all the materials in the e-content module, and they agreed that all materials were relevant to the SKU3063 Chemistry course. The findings of the content validity evaluation form showed that the I-CVI for each content is 1.00 and overall S-CVI/Ave is also 1.00. Thus, it could be concluded that e-content module for Chemistry MOOC has high content validity.
The third objective of this study is to identify the reliability of the e-content module for Chemistry MOOC. According to Russell (1974), reliability of the module is closely related to the ability of learners to fulfil all the activities presented in the module. To do this, module reliability questionnaire was distributed to the students during pilot study to investigate whether they can follow all the materials presented to them in the e-content module. Cronbach's alpha was employed to test the internal consistency of the items in each topic. All topics presented high-reliability value with Cronbach's alpha values ranging from 0.93 to 0.95 as indicated in Table 6. The findings showed the overall reliability index of e-content module for Chemistry MOOC is 0.94. Based on Noah and Ahmad (2005), the reliability of a module can be analysed using the Cronbach's alpha method to obtain the value of reliability coefficient. If the value of Cronbach's alpha is more than 0.60, the instrument is acceptable. If the value of Cronbach's alpha is more than 0.90, then the instrument has very high reliability (Hair, Black, Babin & Anderson, 2009). Hence, this study found a high reliability coefficient for the e-content module for Chemistry MOOC.
The last objective of this study is to identify students' perceptions in terms of content, usability, design and effectiveness of e-content module for Chemistry MOOC. Respondents showed their agreement on the items in the questionnaire based on 4-point Likert scale. The findings of the perception questionnaire are presented in Table 7.  Table 7. Mean and standard deviation of constructs in perception questionnaire (Hamid, 2020) Results showed the mean value for the content construct is the highest (M = 3.66, SD = 0.55) among the constructs in the perception questionnaire. Content refers to materials presented in the e-content module, for instance PowerPoint slides and videos for Nuclear Chemistry, Quantum Theory and Periodic Table, Chemical Bonding, and Stoichiometry of Formulas and Equations topics. Related content provided and useful resources recommended by the educators could help learners to meet the learning outcomes (Nganji, 2018). In this study, students understood well the language used in the e-content module, both in PowerPoint slides and videos. They agreed all the learning materials are well structured, interconnected with each topic and suitable with their level of understanding. All these characteristics of e-content module seem to meet the criteria of course quality suggested by Yang, Shao, Liu and Liu (2017). These results also are paralleled with previous studies (Liu, Kang & McKelroy, 2015;Watson, Loizzo, Watson, Mueller, Lim & Ertmer, 2016), showing that learners have positive perception of the lecture/videos and reading/resources as impactful instructional materials within the MOOC. MOOC serves as personalised e-learning platform where learners are highly engaged with the learning content. The learners will achieve the learning outcomes and improve their performance in the long run by engaging with the learning content (Nganji, 2018).
The second construct in the perception questionnaire is usability with mean value 3.43 and standard deviation 0.56. Usability refers to the interface of the software which could ease the users when they use the software (Alon & Herath, 2014;Khamis, 2009;Ujang, 2016). It involves the ease of use of the learning environment, such as the navigation, how easy it is to find specific content and generally how easy it is to use the environment (Nganji, 2018). Hence, instructor needs to ensure that learning materials are available and easily accessed so that learners could manage their learning in their own time. Zalli, Nordin and Hashim (2019) found that planning, time management and self-evaluation are significant factors that influence MOOC users' satisfaction. A good navigation of MOOC could satisfy the users. Technical problems such as unable to access videos, submit scores, navigating through discussion forum made learners felt disappointed (Watson et al., 2016). To help learners remain engaged in the MOOCs, instructors should ensure the system quality by making sure that all the learning materials can be quickly loaded, the links are easily navigated and the platform functions well all the time (Yang et al., 2017).
Design is the construct with the lowest mean value, 3.41 (SD = 0.59). Design involves the items about the organization, colour, graphic, interactivity, video and other elements involved in the interface of e-content module in Chemistry MOOC. Majority of the students agreed the colours used in the module are interesting, the interface design and graphics presented in the module caught their attention. Design of the MOOC is part of system quality that contributes to persistent intention of learners toward participation in the MOOCs (Yang et al., 2017). Learners perceive better learning performance when the course design such as the interface, content design and the flow of content is congruent with their learning preferences (Handoko et al., 2019). Good interface designs promote learners' levels of engagement and allow effective pedagogical principles to benefit learners (Liu et al., 2015).
The construct of effectiveness obtains the second highest mean score (M = 3.47, SD = 0.56). Effectiveness in the present study refers to the impact of using e-content module on students' chemistry concept mastery. Most of the students agreed they could understand the concepts of Stoichiometry of Formulas and Equations, Quantum Theory and Periodic Table, Chemical Bonding, and Nuclear Chemistry after learning with e-content module in Chemistry MOOC. The learning material of these topics were presented to the students in the form of PowerPoint slides and videos. Studies showed that using videos as instructional material could improve students learning performance and achieve learning outcomes successfully (Bonafini, Chae, Park & Jablokow, 2017;Chen & Wu, 2015;Chi, Pickrell & Riedy, 2014;Kissi, Nat & Armah, 2018). Using videos in self-paced online learning such as MOOCs support self-regulated learning (Handoko et al., 2019;Lai & Hwang, 2016;Zimmerman, 2013) and enable learners to engage in the learning environment at their own pace (Yakubova, Hughes & Hornberger, 2015). A learner needs to have self-regulation to be actively involved in the learning process using MOOC (Zalli, Nordin & Hashim, 2020).

Conclusion
The e-content module for Chemistry MOOC has been successfully developed using ADDIE instructional design model. CVI is 1.00 showing that the e-content module for Chemistry MOOC has high content validity. Next, the reliability coefficient of e-content module for Chemistry MOOC (α = 0.94) demonstrated the internal consistency of the scale was acceptable. The Cronbach's alpha values ranged from 0.93 to 0.95 revealing satisfactory discriminating power. The mean scores for students' perceptions of the module ranged from 3.41 to 3.66 revealing high perception level in the content, usability, design and effectiveness constructs. This e-content module for Chemistry MOOC can be a guidance and a resource for lecturers and students who involved in the teaching and learning of Chemistry in blended learning or flipped classroom platform.