A SEQUENTIAL EXPLANATORY INVESTIGATION OF TPACK: INDONESIAN SCIENCE TEACHERS’ SURVEY AND PERSPECTIVE

This sequential explanatory design aims at exploring science teachers’ perceptions of technology integration regarding technological pedagogical content knowledge (TPACK) which focused on quantitative findings (survey) supported by qualitative findings (interview). The study involved 356 respondents for the survey and eight participants for the interview. Descriptive statistics, t-test and ANOVA were used in the quantitative data analysis while for the qualitative data analysis, a thematic process was conducted. Findings show that the science teachers’ perception of their technological-based knowledge is lower than non-technological knowledge namely pedagogical and content knowledge. Further, qualitative findings informed in-depth information about technology integration referred to TPACK namely problems in technology integration, advantages of technology integration, students centered learning, knowledge of new technology and its classroom integration, and peer collaboration. Policy recommendation was established for the betterment of ICT integration in instruction, especially for developing countries.

Knowledge in relation to the effective implementation of technology in education is also important for the 21 st -century teachers (ISTE, 2018). In the beginning, teachers taught their students focusing primarily on technology skills regardless of the pedagogical or content aspects (Graham, Culatta, Pratt & West, 2004). Today's teachers including science teachers recognized that technological skills alone did not contribute well for students' learning promotion without teachers understanding how to use technology in effective ways related to pedagogical and subject content aspects. Therefore, the focus of educational technology studies has shifted from teaching merely technology skills to effectively integrating technology into teaching (Mishra & Koehler, 2006).
In 2006, Mishra and Koehler found technological pedagogical and content knowledge (TPACK) which many researchers recognized this framework brings the influence of content domain in technology use in pedagogy. The new framework was established upon Lee Shulman's widely cited Pedagogical Content Knowledge (PCK) framework (Shulman, 1987). There have been many studies involved TPACK framework in technology integration in education in developed countries (e.g. Bostancıoğlu & Handley, 2018;Graziano, Herring, Carpenter, Smaldino, & Finsness, 2017;Martin, 2018), including in science education (e.g. Barak, 2017;Constantine, Rozowa, Szostkowski, Ellis, & Roehrig, 2017;Enderson & Watson, 2019;Jang & Tsai, 2013;Joo, Park, & Lim, 2018;Lin, Tsai, Chai & Lee 2013). However, very few studies have been conducted measuring TPACK teachers' level in Indonesia as one of the developing countries. Therefore, this mix method study was conducted to fill the gap. To achieve the research purposes, two guiding questions were established: 1. What is the Indonesian science teachers' level of TPACK? 2. Is there any significant difference of TPACK level between the science teachers in term of; gender, age, and teaching experience? 3. How do they perceive technology integration related to TPACK?

Literature Review
Todays' achieved science teachers are likely the teachers who successfully establish appropriate strategies of science knowledge to achieve successful teaching with technologies (Constantine et al., 2017). To measure the knowledge of technology integration into teaching, one well-known framework is TPACK developed by Mishra and Koehler (2006). They have highlighted the needs of modern teachers to bring pedagogical knowledge, technological knowledge, and content knowledge. In addition, they combined the complicated relationship among the domains.

The Origin of TPACK
The ideas in order to investigate factors affecting the integration of ICTs during teaching is not something new; however, it should always be updated with the influence of the development of education from time to time (Lawrence & Tar, 2018). As discussed by Adnan and Tondeur (2018), today's teacher training programs still look for proper courses, trainings, and practices to improve teachers' competence in integrating ICTs into teaching. Studies have informed that some characteristics of teachers may affect the ICTs integration such as beliefs (Gne & Bahivan, 2018) self-efficacy (Krause, 2017;Yerdelen-Damar, Boz & Aydın-Günbatar, 2017), attitudes (Suana, 2018), and acceptance (Kale, 2018). Those characteristics are related to teachers' comprehension of some technological devices regarding subject matter, students' needs and instructional condition (Adnan & Tondeur, 2018). Beyond that, many teacher training programs have changed their paradigm to exploring competencies of ICTs with regard to knowledge perspective which firstly based on Shulman's (1987) pedagogical content knowledge (PCK).
TPACK, formerly TPCK (Mishra & Koehler, 2006), has been stimulating teacher training programs to form teacher's knowledge, pre-service and in-service, with a concise framework that involves integrates technology, pedagogy, and content in a direct way. This framework has been widely adopted and adapted by the educational application of ICT researchers from time to time (Baran, Canbazoglu-Bilici, Albayrak-Sari & Tondeur, 2017;Bostancıoğlu & Handley, 2018;Graziano et al., 2017;Martin, 2018). The well-known Venn-circled diagram picturing three basic domains of TPACK; technological knowledge (TK), pedagogical knowledge (PK), and content knowledge (CK) is widely used in ICTs integration research. The intertwined domains (four domains) of the knowledge model are understood to be distinct domains essential of the basic knowledge domains; technological content knowledge (TCK), technological pedagogical knowledge (TPK), and pedagogical content knowledge (PCK), as well as technological pedagogical and content knowledge (TPACK). To more understand the seven factors, Mishra and Koehler (2006) have defined TPACK in simple explanation (see Table 1). In recent previous studies, researchers have extensively used the framework in variation of population of research, such as pre-service teachers (e.g. Scherer, Tondeur, Siddiq & Baran, 2018;Tondeur, Scherer, Siddiq & Baran, 2017;Yurdakul, 2018), in-service teachers (Chen & Jang, 2018;Hsu,Tsai, Chang, & Liang, 2017), online distance teachers (Joo et al., 2018;Dalal, Archambault & Shelton, 2017), and teachers in professional development courses (Harris & Hofer, 2017;Koh, Chai & Lim, 2017). The importance of TPACK studies will be developed from time to time and differences between countries due to technology development and educational policy. Emphasizing teachers' TPACK development is also crucial for different research populations including for science teacher education.

Science Teachers' TPACK
In-service teachers training programs have broadly achieved the general agreement of technologies that deliver a huge impact on instruction (Dalal et al., 2017). It has been recommended that ICT for instructional strategies to improve for example science learning; provoking cognitive factors (Tchoshanov, Cruz, Huereca, Shakirova, Shakirova & Ibragimova, 2017) and providing adaptation in learning with scaffolding (Niess, 2018). In more general terms, technologies have been continuously informed and discussed for its contribution to learning strategies namely, cooperative learning, problem-based learning, contextual learning, and situated learning as well as collaborative learning (Ifinedo, Kankaanranta, Neittaanmäki & Hämäläinen, 2017).
However, some critics have addressed to the inclusion of technological applications in science as excessively technocentric (Chai, Koh, & Tsai 2010). The technocentric approach also failed to address the gaps between technology integration theories and practice in educational settings where science teachers could experience many barriers; technology facilities, teachers' technology attitudes and knowledge, technology funding, traditional style of teaching, professional development, district and school culture (Alkhawaldeh & Menchaca, 2014;Ertmer, Ottenbreit-Leftwich, Sadik, Sendurur, & Sendurur, 2012). In authentic classroom circumstances, teachers should do essential efforts to achieve technology integration for the specific topic for specific students. As such, science teachers need to consider students' need and ability to learn using technology. One of the comprehensive frameworks to minimize this is the TPACK Studies have also been addressed within the context of TPACK in science studies (Barak, 2017;Constantine et al., 2017;Enderson & Watson, 2019;Joo et al., 2018). Teachers' attitudes for the TPACK are positively associated with instructional practices. A different aspect of school context affects practices (Constantine et al., 2017). In addition, Enderson and Watson (2019) informed a case approach applied for modeling and simulation applications in a science, technology, engineering, and mathematics (STEM) teacher preparation program to help the establishment of the TPACK. In science, technology has been emphasized to enhance the learning of the concepts (Joo et al., 2018) and thought as a strong toll supporting learners' activities. In such condition, science teachers must be trained with related knowledge to integrate ICTs in instructional activities.
Many applicable models of TPACK have been explored by researchers in order to employ academic proof to agree on the framework. Mishra and Koehler (2006) developed an instrument of a survey to assess the effect of a course in accordance with their TPACK which related to the seven domains. However, it was in nature course so that it did not represent the TPACK model for teachers whose major are not natural science. On the other hand, Lee and Tsai (2010) surveyed teachers' TPACK specifically for content Knowledge-Web technology. Lin et al. (2013) and Jang and Tsai (2013) develop survey instruments to examine science teachers' TPACK that were used in this current study.

Design of the Study
Mix method study, sequential explanatory design, is conducted to explore a phenomenon of the study within involving some data sources as well as establishing reliability and validity of the findings (Creswell, 2014). Sequential explanatory design relies on the quantitative data supported by qualitative data to achieve the purposes of the study (Creswell, 2014) Through this method, we did an investigation of TPACK level of Indonesian science teachers, the difference of TPACK level between the science teachers in term of; gender, age, and teaching experience, and the science teachers' perception of technology integration related to TPACK. The study was done for eight months from November 2017 to June 2018 in one Indonesian province. This study is part of a bigger study examining Indonesian K-12 school teachers' technology integration funded by the Indonesian ministry of higher education, research and technology.
We used two kinds of data sources, survey and interview, in order to answer the research questions. In mix method study, multiple data methods e.g. survey, observation, interviews, group discussion, and document analysis are significant (Stake, 1995). The data collection method should be related to research approaches. The two data collection methods are important to provide full and detail information in this study. This study was begun with a quantitative process followed by qualitative data collection and analysis.

Quantitative
The population of this study is all Indonesian high school science teachers. However, the sample was 356 science teachers who teach in one Indonesian province (see Table 2). We distributed survey printed survey instruments to 500 science teachers where 402 instruments were returned and 46 instruments were not able to calculate; some statements were not answered by the respondents.
In considering and identifying a suitable survey instrument to investigate Indonesian science teachers' level of TPACK, we adapted a survey from a previous study (Lin et al., 2013;Jang & Tsai, 2013). The instrument which standardized validity coefficient was from .71 to .93 applied SEM in constructing the model. There were 27 items included in the 7 domains of TPACK; four items of technological knowledge (TK), 6 items of pedagogical knowledge (PK), 3 items of content knowledge (CK), 3 items of technological content knowledge (TCK), 5 items of technological pedagogical knowledge (TPK), 2 items of pedagogical content knowledge (PCK), as well as 4 items of technology, pedagogy, and content (TPC).
The instrument was discussed by a panel of educational technology experts and English-Indonesian translation experts for content validity before being distributed. The discussion with the experts of educational technology aimed at agreeing the technological application in the original instrument (Lin et al., 2013;Jang & Tsai, 2013) with the condition of Indonesian schools. In addition, the translation experts were involved since the survey items were translated from English to Bahasa Indonesia. Based on the content validity, some wordings were changed such as "I have the technical skills to use computers effectively" to be "I have the technical skills to use the internet and computers effectively". One item in TPK was eliminated due to the context matter. Therefore, the final survey of this study consists of 26 items for TPACK domain questions with an average internal consistency of .86 acceptable for the TPACK. Four items for demographic information (gender, age, and teaching experience) We distributed the survey questionnaires helped by two high school teachers and one research assistant.
After the data collection, we computerized the data and saved them into Microsoft Excel. We then calculated the data and measured their frequency, percentage, mean, and standard deviation (descriptive statistics) to investigate the teachers' TPACK level. We used t-test and ANOVA to evaluate the differences among moderating variables. We used t-test and ANOVA to evaluate the differences among moderating variables.

Qualitative
To more understand science teachers understanding of technology integration in their school, we interviewed eight participants who filled in "yes" in agreement statement in the survey. Semi-structure interview questions were adapted from the survey items. These questions were listed to understand how interventions push and how they are allowing interviewers to have talks on the issues that may not be brought in the other study method of data collection (Creswell, 2014).
In the agreement column of the questionnaire, twenty-five science teachers filled in "yes" but we contacted only eight teachers whose age range from 25-50 years old (see Table 3). The interviews were conducted to obtain in-depth information in relation to the technology integration in for their teaching subject, science. The interviews were carried out in Bahasa Indonesia lasting from 40 to 45 minutes. We masked the participants' identities using pseudonyms for ethical consideration of in order to keep safe human right protection. Science teachers' decision to be in the study for the interview sessions was voluntary as we provided them informed-consent forms.
For the data analysis, we implemented what (Miles & Huberman, 1994) called "within case analysis." We interviewed the eight participants one by one by audio-taping. After that, we did data transcription suing Google voice doc. We analyzed and categorized the transcriptions into thematic items. This process was repeated until the last participant, the eight participants. We marked relevant chunks of statements, put relevant chunks of statements into permanent categories and translated the categories from Bahasa Indonesia into English (Creswell, 2014). For the trustworthiness (Miles & Huberman, 1994) of the study, we addressed verbatim statements of the transcription followed by member checking procedures (Creswell, 2014;Habibi et al., 2018). We did checking procedures with both all participants of the interview and all researchers' members. We gave the interview data to the participant to obtain their feedback and agreement. This step was conducted in order to decrease the bias of the research. The participants agreed the data of the study to be presented. Ryan  M  28  3  Siti  F  44  19  Kendal  F  53  32  Thomas  M  45  21  Febby  F  34  10  Katty  F  51  23  Budi  M  34  11  Cassie  F  46  23   Table 3. Participants in the interview and the location 4. Findings

Indonesian Science Teachers' Level of TPACK?
Firstly, the seven domains of TPACK were separately calculated for the mean, standard deviation, and Cronbach alpha (see Table 4).

The Difference of TPACK Level between the Science Teachers in Term of; Gender, Age and Teaching Experience?
The t-test was conducted to gain differences in terms of respondents' gender (see Table 5). Even though, it was reported that there were no significant differences of scale scores of CK and TCK from both female and male respondents, most of the domains have been reported to have a significant difference. There were significant differences in scores for males (mean=3.24, SD=.81) having higher scores of TK than that of females (M=3.00, SD=.48) with p = .013. Females (mean=2.90, SD=.79) informed lower scores than males (mean=3.14, SD=.79) in TPK, p = .004 along with TPC, females (mean=2.86, SD=.87) than males (mean=3.10, SD=.80), p = .004. However, females (mean=3.87, SD=.54) reported significantly higher scores than males (mean=3.69, SD=.46), p = .024 in PK as well as in PCK, females (mean=3.82, SD=.68) than males (mean=3.65, SD=.5), p = .049.
A series of one-way ANOVA tests were done in order to compare scores in the TPACK domains in terms of age and teaching experience (see Table 6). One-way analysis of variance indicated significant differences in TK and TPK based on the age of respondents. Participants were divided into three groups according to their age (25-35; 36-45 and 46-55). There was a statistically significant difference at the p < .005 level in TK scores for the three groups of age groups, p = .003. In addition, there was a statistically significant difference at the p < .05 level in TPK scores, p = .026. There were no other significant differences in TPACK domain scores in terms of respondents' age and teaching experience.

Perceived Technology Integration Related to TPACK
To discuss the research question number three, science teachers' perception on technology integration in relation to TPACK, we interviewed the eight participants; the interview guiding questions were constructed based on the result of the survey analysis. The findings are thematic and explained in this section (see Table 7). the themes of this study consist of five items; problems in technology integration, advantages of technology integration, students; cantered learning, knowledge of new technology and its classroom integration, and peer collaboration.
Problems in technology integration are represented by nineteen statements which the elaboration can be related to TK, TPK, TCK, and TPACK. The problems varied from internal and external problems faced by the science teachers. Most teacher, especially senior ones, revealed that their skills of technology and technology integration in teaching were the most challenge that they have to deal with. Other teachers were complaining about the lack of infrastructure supporting technology integration, teachers' developments relate to technology integration, and lack of human resource or technology supporting technicians, as well as the limited support provided by school administrators. "As a senior teacher, I do not have good skills of either ICT or its integration in classrooms. That is the major problems I have in the ICT application" (Siti) The elaboration of problems faced in technology integration (TK, TPK,  TCK, TPACK) Advantages of technology integration 20 "In science, if you are good in technology like simulation, video applications, and others, it will be so much supporting the instruction" The information on the advantages of ICT integration in the teaching and learning processes (TK, TPK, TCK, TPACK) Students centered learning 11 "Science students welcome the use of technology; they love searching information on the Internet; it is more complete information the Internet provides" (Budi) The elaboration of students centered learning through the integration of technology (PK, CK, TPK, TPACK) Knowledge of new technology and its classroom integration 10 "I watched a good video in a Youtube channel about science and found a good application and simulation to be applied in my classroom. I am happy to share it with my students" (Cassie) The information of new technology discovery that might be beneficial to be implemented in teaching and learning processes (TK, TPK, TCK, TPACK).

Peer collaboration 13
"I discussed some technology applications in my informal meeting and it helps me integrate technology in my instruction" (Thomas) The reflection of how the participants collaborate by helping or informing each other about the use technology in the classroom (TK) On the other hand, the advantages of technology in teaching and learning processes were also discussed. some advantages like facilitating interesting learning situation in the classroom, engaging critical learning, and improving peer collaboration among. One of the participants revealed that by using technology in the science classroom, the explanation of teaching material would be simpler and clearer. The information about the advantages of ICT integration in the teaching and learning processes is in close relation to domains of TK, TPK, TCK, TPACK. Further, on many occasions in the interview sessions, the interviewees underlined the learning style students possessed, should the technology integration be implemented in their teaching and learning processes. One of many quotes revealed, Using technology namely the Internet makes students become more active and independent. They are more independent and sometimes more knowledgeable than we are (Kendal) The science teacher in the interview also informed about knowledge of new technology and its application in the classroom. They gain new knowledge from what they learn and understand if the technology is used in their teaching and learning activity. One of the participants, Thomas, stated that he once knew about Edmodo and applied in his classes. He still uses the application until today. The teacher' information about the new technology discovery and its integration could be important in the instruction and related to TK, TPK, TCK, TPACK. Lastly, thirteen statements from the interviewees mentioned about peer collaboration in their technology integration promotion. They informed that peer collaboration helped them improve their skills and knowledge as well as self-efficacy in technology integration. The peer collaboration emerging from the qualitative data finding might be in relation to technological knowledge (TK).

Discussion
Results informing Indonesian science teachers' all seven TPACK domains, with CK informed as of the highest score obtained by the teachers followed by PK and PCK. Qualitatively, most Indonesian science teachers' technology said in the interview that they had been exposed to use technology in their teaching and learning processes for the only last five years. As a result, it might lower the level of domains' TK, TCK, and TPK. The findings contrast to previous findings (Joo et al., 2018) which informed the scores of TK, TCK, TPK, and TPACK were either similar or higher than the score of PK and CK as well as PCK.
In general, there is no significant difference in terms of teaching experience and age of TPACK domains informed in this study. However, significant differences exist in term of gender where male respondents for TK, PK, TPK, and TPACK. Male respondents informed higher scores in technological-based knowledge while females gain higher scores in PK and PCK. These findings were similar to those of other previous studies (e. g. Alkhawaldeh & Menchaca, 2014).
Qualitatively, the findings support the results of the quantitative findings. Most of the participants talked about barriers in technology integration which seem to influence the score of TK, TPK, TCK, and TPACK. The in-depth information elaborated informed barriers including lack of teacher educators' skill, limited infrastructure, lack of human resource supporting the technology integration, and little support from school principals. Similarly, the barriers informed in this study were also discussed by previous researchers (Chai et al., 2010). In specific term, the barriers include limited technology tools and access of the Internet, teachers' lack of experience, and lack of workshops and seminars were elements to reduce technology integration (Alkhawaldeh & Menchaca, 2014;Ertmer et al., 2012).
Even though the level of technology-based knowledge was low, the majority of teachers perceived that technology is advantageous to improve instruction. Some advantages that emerged from the session of interviews include technology which facilitates thought-provoking learning situation in the classroom, engages critical learning, and improves peer collaboration among science teachers. The awareness of the technology advantages in instruction was also revealed by previous studies (e.g Dalal et al., 2017;. They also learn new technology through peer collaboration with their peers (Dalal et al., 2017).

Conclusion
The findings of this study inform significant and in-depth insight into science teachers' perception of technology integration through the lens of TPACK (technological knowledge, pedagogical knowledge, content knowledge, technological pedagogical knowledge, technological content knowledge, and technological pedagogical and content knowledge). Both the quantitative and qualitative finding revealed the barriers and advantages of technology integration related to TPACK framework. The barriers should be minimized and the advantages should be improved.
The low score of technology-based knowledge should be related to the barriers experience by the participants, science teachers. In order to minimize the barriers, further research involving all stake holders including authorities e.g. school principals, teacher supervisors, and educational department should be conducted. Workshop, seminar, and trainings are suggested to hold in relation to technology integration in instruction. The initial or basic technology skills and pedagogy was important in order to establish selfefficacy of science teacher in technology integration. A platform for the science teachers' TPACK should also be considered to be established. For future science teachers, teacher education programs are recommended to comprehensively hold courses and training to improve the integration of technology into science courses. Further research on science teacher educators and pre-service teachers is also encouraged. Teacher perception on the advantages of technology integration in science classrooms (facilitating thought-provoking learning situation in the classroom, engaging critical learning, and improving peer collaboration among science teachers) should be maintained. Reward and punishment in teaching with technology and its innovation is encouraged to conduct.

Declaration of Conflicting Interests
The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Funding
The authors received no financial support for the research, authorship, and/or publication of this article.