Research Article

Using natural language processing to analyze elementary teachers’ mathematical pedagogical content knowledge in online community of practice

Jiseung Yoo 1 , Min Kyeong Kim 1 *
More Detail
1 Ewha Womans University, Seoul, SOUTH KOREA* Corresponding Author
Contemporary Educational Technology, 15(3), July 2023, ep438, https://doi.org/10.30935/cedtech/13278
Published Online: 15 May 2023, Published: 01 July 2023
OPEN ACCESS   1317 Views   807 Downloads
Download Full Text (PDF)

ABSTRACT

This study focuses on how teachers’ pedagogical content knowledge (PCK) of mathematics may differ depending on teacher interactions in an online teacher community of practice (CoP). The study utilizes data from 26,857 posts collected from the South Korean self-generated online teacher CoP, ‘Indischool’. This data was then analyzed using natural language processing techniques; specifically, text classification with word2vec, BERT, and machine learning classifiers was used. The results indicate that the texts of posts can predict the level of teacher interactions in the online CoP. BERT embedding and classifier exhibited the best performance, ultimately achieving an F1 score of .756. Moreover, topic modeling utilizing BERT embedding is used to uncover the specific PCK of teachers through high- and low-interaction posts. The results reveal that high-interaction posts with numerous likes and replies demonstrate more in-depth reflections on teaching mathematics and refined PCK. This study makes two significant contributions. First, it applies a data science framework that allows for the analysis of real data from an actual online teacher community. Secondly, it sheds light on the intricacies of knowledge management in an online teacher CoP, an area that has to this point received limited empirical attention.
Keywords: online community of practice, natural language processing, mathematics pedagogical content knowledge, knowledge management

CITATION (APA)

Yoo, J., & Kim, M. K. (2023). Using natural language processing to analyze elementary teachers’ mathematical pedagogical content knowledge in online community of practice. Contemporary Educational Technology, 15(3), ep438. https://doi.org/10.30935/cedtech/13278

REFERENCES

  1. Ball, D. L., & Bass, H. (2003). Toward a practice-based theory of mathematical knowledge for teaching. In B. Davis, & E. Simmt (Eds.), Proceedings of the 2002 Annual Meeting of the Canadian Mathematics Education Study Group (pp. 3-14).
  2. Ball, D. L., Thames, M. H., & Phelps, G. (2008). Content knowledge for teaching: What makes it special? Journal of Teacher Education, 59(5), 389-407. https://doi.org/10.1177/0022487108324554
  3. Barab, S. A., MaKinster, J. G., & Scheckler, R. (2003). Designing system dualities: Characterizing a web-supported professional development community. The Information Society, 19(3), 237-256. https://doi.org/10.1080/01972240309466
  4. Barker, R. (2015). Management of knowledge creation and sharing to create virtual knowledge-sharing communities: A tracking study. Journal of Knowledge Management, 19, 334-350. https://doi.org/10.1108/JKM-06-2014-0229
  5. Bergviken-Rensfeldt, A., Hillman, T., & Selwyn, N. (2018). Teachers ‘liking’ their work? Exploring the realities of teacher Facebook groups. British Educational Research Journal, 44(2), 230-250. https://doi.org/10.1002/berj.3325
  6. Booth, S. E. (2012). Cultivating knowledge sharing and trust in online communities for educators. Journal of Educational Computing Research, 47(1), 1-31. https://doi.org/10.2190/EC.47.1.a
  7. Bozkurt, A., Koutropoulos, A., Singh, L., & Honeychurch, S. (2020). On lurking: Multiple perspectives on lurking within an educational community. The Internet and Higher Education, 44, 100709. https://doi.org/10.1016/j.iheduc.2019.100709
  8. Brown, R., & Munger, K. (2010). Learning together in cyberspace: Collaborative dialogue in a virtual network of educators. Journal of Technology and Teacher Education, 18(4), 541-571.
  9. Burkink, T. (2002). Cooperative and voluntary wholesale groups: Channel coordination and interfirm knowledge transfer. Supply Chain Management: An International Journal, 7(2), 60-70. https://doi.org/10.1108/13598540210425812
  10. Davenport, E. (2001). Knowledge management issues for online organizations: ‘Communities of practice’ as an exploratory framework. Journal of Documentation, 57(1), 61-75. https://doi.org/10.1108/EUM0000000007077
  11. Davis, T. (2013). Building and using a personal/professional learning network with social media. The Journal of Research in Business Education, 55(1), 1-13.
  12. Dibie, O., & Sumner, T. (2016). Using weak ties to understand the resource usage and sharing patterns of a professional learning community. Social Network Analysis and Mining, 6(1), 6-27. https://doi.org/10.1007/s13278-016-0335-z
  13. Faraj, S., Jarvenpaa, S. L., & Majchrzak, A. (2011). Knowledge collaboration in online communities. Organization Science, 22(5), 1224-1239. https://doi.org/10.1287/orsc.1100.0614
  14. Faraj, S., Kudaravalli, S., & Wasko, M. (2015). Leading collaboration in online communities. MIS Quarterly, 39(2), 393-412. https://doi.org/10.25300/MISQ/2015/39.2.06
  15. Fesenmaier, J., & Contractor, N. (2001). The evolution of knowledge networks: An example for rural development. Community Development, 32(1), 160-175. https://doi.org/10.1080/15575330109489697
  16. Gao, F., Luo, T., & Zhang, K. (2012). Tweeting for learning: A critical analysis of research on microblogging in education published in 2008-2011. British Journal of Educational Technology, 43(5), 783-801. https://doi.org/10.1111/j.1467-8535.2012.01357.x
  17. Goodyear, V. A., Casey, A., & Kirk, D. (2014). Tweet me, message me, like me: Using social media to facilitate pedagogical change within an emerging community of practice. Sport, Education and Society, 19(7), 927-943. https://doi.org/10.1080/13573322.2013.858624
  18. Greenhow, C., Galvin, S. M., Brandon, D. L., & Askari, E. (2020). A decade of research on K–12 teaching and teacher learning with social media: Insights on the state of the field. Teachers College Record, 122(6), 1-72. https://doi.org/10.1177/016146812012200602
  19. Grootendorst, M. (2022). BERTopic: Neural topic modeling with a class-based TF-IDF procedure. arXiv, 05794. https://doi.org/10.48550/arXiv.2203.05794
  20. Grossman, P. L. (1989). A study in contrast: Sources of pedagogical content knowledge for secondary English. Journal of Teacher Education, 40(5), 24-31. https://doi.org/10.1177/002248718904000504
  21. Hansen, M. T. (1999). The search-transfer problem: The role of weak ties in sharing knowledge across organization subunits. Administrative Science Quarterly, 44(1), 82-111. https://doi.org/10.2307/2667032
  22. Hara, N., & Kling, R. (2002). Communities of practice with and without information technology. In E. G. Toms (Ed.), Proceedings of the 65th American Society for Information Science and Technology Annual Meeting (pp. 338-349). Information Today. https://doi.org/10.1002/meet.1450390137
  23. Hill, H. C., Sleep, L., Lewis, J. M., & Ball, D. L. (2007). Assessing teachers’ mathematical knowledge: What knowledge matters and what evidence counts? In F. Lester (Ed.), Second handbook of research on mathematics teaching and learning (pp. 111-156). Information Age Publishing.
  24. Hillman, T., Lundin, M., Rensfeldt, A. B., Lantz-Andersson, A., & Peterson, L. (2021). Moderating professional learning on social media: A balance between monitoring, facilitation and expert membership. Computers & Education, 168, 104191. https://doi.org/10.1016/j.compedu.2021.104191
  25. Hu, S., Torphy, K. T., Opperman, A., Jansen, K., & Lo, Y. J. (2018). What do teachers share within socialized knowledge communities: A case of Pinterest. Journal of Professional Capital and Community, 3(2), 97-122. https://doi.org/10.1108/JPCC-11-2017-0025
  26. Hur, J. W., & Hara, N. (2007). Factors cultivating sustainable online communities for K-12 teacher professional development. Journal of Educational Computing Research, 36(3), 245-268. https://doi.org/10.2190/37H8-7GU7-5704-K470
  27. Indischool. (2022). Indischool statistical data. Brunch. https://brunch.co.kr/@indischool/70
  28. Jin, F., & Wang, Y. (2022). The emergence of community knowledge in a complex network-based folksonomy self-organization mode. In Proceedings of the 11th International Conference on Software and Information Engineering (pp. 62-65). https://doi.org/10.1145/3571513.3571524
  29. Kim, D. H. (2008). The development process of network-based community of practice for teachers’ knowledge sharing and expertise development: A case study of Indischool. Journal of Educational Technology, 24(2), 1-30. https://doi.org/10.17232/KSET.24.2.1
  30. Kim, H., Hwang, S., Kwak, Y., & Choi, J. (2022). Can online community managers enhance user engagement? Evidence from anonymous social media postings. Knowledge Management Research, 23(2), 211-228. https://doi.org/10.15813/kmr.2022.23.2.011
  31. Krutka, D. G., & Carpenter, J. P. (2016). Participatory learning through social media: How and why social studies educators use Twitter. Contemporary Issues in Technology and Teacher Education, 16(1), 38-59.
  32. Lantz-Andersson, A., Lundin, M., & Selwyn, N. (2018). Twenty years of online teacher communities: A systematic review of formally-organized and informally-developed professional learning groups. Teaching and Teacher Education, 75, 302-315. https://doi.org/10.1016/j.tate.2018.07.008
  33. Lee, D., Jung, J., Shin, S., Otternbreit-Leftwich, A., & Glazewski, K. (2020). A sociological view on designing a sustainable online community for K–12 teachers: A systematic review. Sustainability, 12(22), 9742. https://doi.org/10.3390/su12229742
  34. Leung, J. (2022). An NLP approach for extracting practical knowledge from a CMS-based community of practice in e-learning. Knowledge, 2(2), 310-336. https://doi.org/10.3390/knowledge2020018
  35. Liljekvist, Y. E., Randahl, A. C., van Bommel, J., & Olin-Scheller, C. (2021). Facebook for professional development: Pedagogical content knowledge in the center of teachers’ online communities. Scandinavian Journal of Educational Research, 65(5), 723-735. https://doi.org/10.1080/00313831.2020.1754900
  36. Liu, J., Wei, J., Liu, Y., & Jin, D. (2022). How to channel knowledge coproduction behavior in an online community: Combining machine learning and narrative analysis. Technological Forecasting and Social Change, 183, 121887. https://doi.org/10.1016/j.techfore.2022.121887
  37. Luo, T., Freeman, C., & Stefaniak, J. (2020). “Like, comment, and share”–professional development through social media in higher education: A systematic review. Educational Technology Research and Development, 68(4), 1659-1683. https://doi.org/10.1007/s11423-020-09790-5
  38. Macià, M., & García, I. (2016). Informal online communities and networks as a source of teacher professional development: A review. Teaching and Teacher Education, 55, 291-307. https://doi.org/10.1016/j.tate.2016.01.021
  39. Matranga, A., & Silverman, J. (2020). An emerging community in online mathematics teacher professional development: An interactional perspective. Journal of Mathematics Teacher Education, 25, 63-89. https://doi.org/10.1007/s10857-020-09480-2
  40. Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013). Efficient estimation of word representations in vector space. arXiv, 3781. https://doi.org/10.48550/arXiv.1301.3781
  41. Nonaka, I., & Takeuchi, H. (2007). The knowledge-creating company. Harvard Business Review, 85(7-8), 162.
  42. Peng, G. (2019). Co-membership, networks ties, and knowledge flow: An empirical investigation controlling for alternative mechanisms. Decision Support Systems, 118, 83-90. https://doi.org/10.1016/j.dss.2019.01.005
  43. Rehm, M., & Notten, A. (2016). Twitter as an informal learning space for teachers!? The role of social capital in Twitter conversations among teachers. Teaching and Teacher Education, 60, 215-223. https://doi.org/10.1016/j.tate.2016.08.015
  44. Ryu, K., & Lee, Y. (2017). Effects of online teacher learning community activities linked with internship course for the improvement of elementary pre-service teacher’s TPACK. The Journal of Korean Teacher Education, 34(2), 417-437. https://doi.org/10.24211/tjkte.2017.34.2.417
  45. Schön, D. A. (1990). Educating the reflective practitioner. Jossey-Bass.
  46. Seo, K. (2011). Collaborative professional development of online teacher community. The Journal of Korean Teacher Education, 28(1), 133-161. https://doi.org/10.24211/tjkte.2011.28.1.133
  47. Shahbaznezhad, H., Dolan, R., & Rashidirad, M. (2021). The role of social media content format and platform in users’ engagement behavior. Journal of Interactive Marketing, 53(1), 47-65. https://doi.org/10.1016/j.intmar.2020.05.001
  48. Shulman, L. S. (1987). Knowledge and teaching: Foundations of the new reform. Harvard Educational Review, 57(1), 1-23. https://doi.org/10.17763/haer.57.1.j463w79r56455411
  49. SKT Brain. (2019). Korean BERT pre-trained cased (KoBERT). https://github.com/SKTBrain/KoBERT
  50. Staudt Willet, K. B., & Carpenter, J. P. (2021). A tale of two subreddits: Change and continuity in teaching-related online spaces. British Journal of Educational Technology, 52(2), 714-733. https://doi.org/10.1111/bjet.13051
  51. Trust, T. (2015). Deconstructing an online community of practice: Teachers’ actions in the Edmodo math subject community. Journal of Digital Learning in Teacher Education, 31(2), 73-81. https://doi.org/10.1080/21532974.2015.1011293
  52. Trust, T., Krutka, D. G., & Carpenter, J. P. (2016), “Together we are better”: Professional learning networks for teachers. Computer & Education, 102, 15-34. https://doi.org/10.1080/21532974.2016.1208506
  53. Tseng, F. C., & Kuo, F. Y. (2014). A study of social participation and knowledge sharing in the teachers’ online professional community of practice. Computers & Education, 72, 37-47. https://doi.org/10.1016/j.compedu.2013.10.005
  54. van Bommel, J., Randahl, A. C., Liljekvist, Y., & Ruthven, K. (2020). Tracing teachers’ transformation of knowledge in social media. Teaching and Teacher Education, 87, 102958. https://doi.org/10.1016/j.tate.2019.102958
  55. Wenger, E., Trayner, B., & De Laat, M. (2011). Promoting and assessing value creation in communities and networks: A conceptual framework. Cambridge University Press.
  56. Xie, Q., & Luo, T. (2019). Examining user participation and network structure via an analysis of a Twitter-supported conference backchannel. Journal of Educational Computing Research, 57(5), 1160-1185. https://doi.org/10.1177/0735633118791262
  57. Zöller, N., Morgan, J. H., & Schröder, T. (2020). A topology of groups: What Github can tell us about online collaboration. Technological Forecasting and Social Change, 161, 120291. https://doi.org/10.1177/0735633118791262