Military Operational Considerations Affecting Distance Learning Experiences

Photo credit: Major Carl Gendron, Camp Julien, Afghanistan, 2004

In terms of design, development, and delivery of distance learning (DL) for the military, it must be acknowledged that the military is a unique target population which often operates in unique contexts. Due to this fact, members often face unique challenges in relation to their DL courses. Depending on the specific operational situation, members often wish to continue their distance learning while in these settings, assuming time and circumstances can allow. My doctoral research, which focused on the overall satisfaction of Canadian Armed Forces (CAF) members on their DL experiences, shed some light on the experiences of members working through DL courses while on operations. This research, which was defended in 2020, included a sample of 368 CAF members who had graduated from CAF Professional Military education programs between the dates of January, 2015 and March, 2018.

In this research, I generally defined operational activities as deployments (foreign and domestic), military exercises, mission training, and working in a high readiness state for deployment.  Clearly, based on the qualitative data gleaned from interviews and survey open-ended questions, operational activities did have an effect on CAF members’ DL experiences. Many members stated that operational activities can cause difficulties with DL studies as the operational activities take members away from their normal schedules. “Certainly,” one member stated, “if you are on DL and there are taskings, deployments, whatever, forest fires, anything that can grab you away from work, that will impact your DL experience.” On the other hand, many members praised DL as a mode of delivery that can enable the continuation of professional development during operations.  One member asserted that “it’s possible to continue to engage in the learning process while deployed – if the technology supports it.”  Another stated that “DL is a viable option in various circumstances, such as while on a mission or deployed out of the country.” Another member stated that whether, “we’re looking at deployments, postings, exercises, high readiness plans… DL enables the learning process to continue through all of it.”  Another member, however, stated that some of their, “classmates had to withdraw due to deployments.” 

Several members mentioned the challenges with being able to focus on DL in an operational setting. One Senior NCM, for example, said that “understanding that when you’re in operations and deployments, the environments, the stresses, and the factors of where you are already keep you quite busy.”  One Junior Officer who had completed the Canadian Armed Forces Junior Officer Development (CAFJOD) program, while aboard a ship, stated that it was “virtually impossible” to complete the courses in a timely manner, “mainly due to inflexible work schedules (watch-keeping).”  Another member mentioned that “deployed operations present a challenge in focusing on the material at times.”  Another stated,“I did the ILP [Intermediate Leadership Program] DL while in Afghanistan.  Super busy and dangerous time.  Could not focus on the course as much as needed.”

Accessing the required equipment was sometimes a challenge that members faced on operations.  One member stated that “at sea, DL is very hard to complete, as there are few available computers that are shared between multiple users, and operational requirements have priority over individual training.” One Senior Non-Commissioned Member (NCM) made the pertinent comment that the availability of equipment during training and extended deployments is often dependent on the type of work a member is doing.  He stated, in French, that “…pour les armes de combat, notre travail est principalement concentré sur le travail manuel et de gestion de personnel. L’accès à un poste informatique est difficile […for combat arms, our work is mainly focused on manual work and personnel management. Access to a computer station is difficult].” 

The most common challenges that many members brought up regarding DL during military operations were issues of connectivity and bandwidth.  While one CAFJOD graduate said he completed three courses while deployed to Afghanistan and, “only on the odd occasion ran into any connectivity difficulties,” others reported more challenges in this respect.  Some members stated that they had dropped DL courses due to connectivity and bandwidth issues on operations.  Another mentioned the difficulty accessing good internet connections while on humanitarian relief operations, such as with the Disaster Assistance Response Team (DART).

“Restricted bandwidth while sailing,” one member stated, “can significantly reduce, or stop, DL progress.”  One ILP graduate stated that “connectivity while at sea was a big problem… There was also the constant risk that you would lose connectivity altogether and lose your work.” Another stated that “if you’re deployed to Africa or something like that, who knows what kind of connection you would actually have to be able to progress it.”  Another member stated that “HMC Ship’s IT software and/or connectivity has created a lot of headaches for students.” One CAFJOD graduate stated that “bandwidth is often severely restricted, making newer DL hard to access.”  One member stated that there was a submariner on their Senior Leadership Program (SLP) course and that due to being on a submarine, “he could only participate when… surfaced, and even then…there was no real interaction [with peers or instructors].”

A couple of sailors even mentioned that members are using time in foreign ports to fulfill their DL commitments.  One Senior NCM stated that “once I was deployed onboard ship the internet wasn’t very good and [so I] had to do extra work before and download info at a café once we docked in another port. Not ideal.” Another stated that “students spend personal time in foreign ports downloading and uploading assignments,” and that, due to this fact, “their quality of life goes way down.”

Military exercises, mission preparation training, and high readiness states can also cause unique challenges to members pursuing professional development via DL.  One ILP graduate remarked that, during major exercises, it is “hard to write and send essays while living off a tank.”  Being in the field can often cause accessibility issues. One Joint Command Staff Program (JCSP) DL graduate stated that he was required to participate in mandatory field exercises during his studies.  In reference to a lack of course flexibility and connectivity while on exercise, he described the scenario he faced.  “Imagine”, he shared, “having to leave the field, go find a Tim Hortons for their Wi-Fi and have to submit content iaw [in accordance with] an arbitrary and completely inflexible timetable. Ridiculous.”  Another mentioned that members sometimes “use their BlackBerry [work cellular phone] to send essays” in the field.  Another shared that “trying to send in your last few assignments in the middle of the field in WX [Wainwright Exercise] will most definitely leave a bad taste in your mouth.”  Another member stated that “conducting DL while on exercise was extremely difficult and led to considerable corner cutting, reducing the quality of the learning.”  Others mentioned how military activities during DL led to more stress and more difficulties finding time to dedicate to DL and meeting course deadlines. 

Members suggested that granting flexibility in professional military education is paramount in enabling members’ success. Such things as allowing for deadline extensions due to other military obligations and ensuring course design flexibility, such as allowing for the downloading of course content and alternative offline activities for members who may not have access to Internet connections, would be beneficial to the military population in dealing with the military-specific considerations that can influence members’ DL experiences.

Much thanks to the members who shared their first-person accounts to help inform the CAF training and education system and enable our collective continuous improvement.

Reference

Jones, K.A. (2021). Satisfaction of Canadian Armed Forces Regular Fores Members with their Distance Learning Experiences [Dissertation]. Athabasca University.

Technology-Enabled Interactions in Distance Learning : Part 3/3 (CAF Members’ Input)

Canadian Armed Forces medic at laptop in back of a LAV
Photo Credit: DND photo IS2011-1036-02 by Sergeant Matthew McGregor

In the previous two blog articles in this serial (1/3 & 2/3), I focused more generally on the concepts of interaction in Distance Learning (DL). In this entry, I will focus specifically on the qualitative findings that I gleaned from my own mixed methods (qualitative & quantitative) doctoral research, within the context of the Canadian Armed Forces (CAF). Although the mixed methods approach gave rich findings, I have always really wanted to specifically share with a wider readership, the words of the CAF members who responded to open-ended questions in my survey and who took part in the interviews that I conducted. In short, my research into CAF DL satisfaction included a sample of those who graduated between Jan, 2015 and March, 2018, from the Officer and Non Commissioned Members (NCM) professional military education programs, which, at the time of this research, were either delivered solely by DL or as blended learning (DL + classroom). In relation, specifically, to the Joint Command and Staff Programme (JCSP), only graduates of the DL version (with visits to the college) were part of the research sample. While, overall, 78% of these CAF members reported that they were somewhat or very satisfied with their DL experiences, 71.7% stated that, all things being equal, they would choose classroom learning over DL. Some interesting nuances emerged from the qualitative data that I happy to share here, in relation specifically to the three types of interactions in DL. More detailed research findings can be found from here.

Today, I will focus solely on DL interactions. It must be noted that this research was completed prior to the COVID pandemic, and as such, we could potentially expect different responses today, based partially on the quick stand-up many organizations moved to, including the CAF, of desktop Internet videoconferencing as a tool to enable synchronous DL. Some residential courses switched to synchronous virtual classes shortly after the pandemic began.

The first category within the theme of DL course quality, within this qualitative thematic analysis, contained members’ comments and perspectives regarding the three forms of interactions described in the previous two blog entries of this series. The interactions category included the following: 1) peer interaction, including comments about networking, 2) interactions with instructors and staff, as well as, 3) interactions with the course content.

Generally, the quality of interactions came up often in members’ qualitative responses to DL satisfaction, with many reporting that they had felt that they were missing out on what they perceived as rich face-to-face opportunities to meet, discuss, and create relationships with their peers that could benefit them throughout their careers.

Some members felt that the online asynchronous forum discussions were valuable for effective interactions with peers. One, for example, said that “they were excellent. Part of it is because you’re forced to interact.” One member said, “getting in contact online with people like that, you meet a lot of people… so I think it’s good.” Another member said that the connections with the other students were great and stated that they would stay in contact with their classmates. One member said that they liked the flexibility in that they could contribute to a discussion at any time, day or night. In an interview, one Senior NCM offered his positive perspective on one aspect of interactions in DL:

“One of the things that distance learning will enable, when we’re looking at group discussion kind of formats, is typically, when you get people physically in a room, group dynamics always take over. You’re going to have one or two people that will naturally take charge of the room, you’ll have one or two people who won’t say a word even if you come around and poke them with a pen and, then, you get the fence-sitters who can go either way. In the virtual chat room [discussion forum] everyone has a voice and they’re not afraid to express opinions.”

Other members, however, found the value of the DL interactions compared negatively to in-class peer interaction. Some stated that students were often just posting the bare minimum to meet the course requirements and that the forum discussions were not engaging. Many stated that they felt they would learn more in an in-class situation rather than, as one member put it, from, “the cold face of a screen.” One Intermediate Leadership Programme (ILP) graduate said that he found himself, “unable to fully engage with other participants.” Another stated that the DL experience, “isolated the users and did not really allow for positive discussions amongst peers.” One Senior Leadership Programme (SLP) graduate stated that “for leadership and command courses nothing [referring to DL] beats face time and learning from others, ‘Friday night in the shacks learning over beers with peers.’” Another stated that “it’s easier to appreciate other experiences when soldiers are assembled in one location.”

One ILP graduate stated, in reference to DL, that “there is no human component, experience, lessons learned. There is no feeling of camaraderie, team building etc.” Another ILP graduate stated that “the over reliance of computers has taken the “human” interaction away from most courses. The “tech net” used to be formed when sitting in a class with peers from different areas.” Another stated that a negative impact of DL, beyond the immediate training, is the “general group mentorship by rank or trade.” Another member stated that DL does not improve our people skills and, “leads to more people ‘leading by email.’” Several of the JCSP graduates shared that they felt the online forums were more effective after the cohort met face to face during the residential visit halfway through the DL course. Some also felt that, following the program, the students from the residential version of the JCSP seem, “to have a greater network of peers and mentors than DL students.”

Some members found that discussions in DL forums were lacking in depth as it was, as one member put it, “difficult to gauge an individual’s perspective without being able to read body language and identify tone.” Another mused that “you don’t get the facial expressions, you don’t get the gestures, you don’t get the intonations.” As one member described, “some things come across as very pointed where they’re not intended to be.” Another member explained that “text and narrative can be taken out of context and read in many different ways,” and yet another member said that “it’s hard to bring emotion into a conversation through a computer screen or through an online chat forum.”

The Canadian Armed Forces Junior Officer Development (CAFJOD) program and the Primary Leadership Qualification (PLQ) did not incorporate any peer interaction in the DL course design. A Junior Officer who had completed the CAFJOD program stated that it was, “a solo endeavor.” Although he said that discussions with peers, outside of the courses, were encouraged, you “have to sit down and do the course all by yourself.” A graduate of the PLQ course suggested that DL courses, “need to be a little bit more interactive.” When I asked him to explain what “more interactive” would be like, he replied with examples such as, “being able to talk to other students,” and “more networking and bouncing ideas and having to work together.” He also reflected that “maybe through other people you can actually learn the information a little bit better yourself.” When asked if any of this type of interactivity was seen in his PLQ, he stated, “None. There was zero.”

Some Advanced Leadership Programme (ALP) graduates shared their disappointment that there was no longer a residential portion of the ALP in that it was presently delivered solely via DL. One ALP graduate stated, “I am extremely dissatisfied with the DL package. It does not foster networking, nor does it allow us to broaden our experience with other trades.” Another member stated that “ALP should have a small portion by DL and bring back the residential portion since that is where your networking is establish[ed] which you cannot have online. The face-to-face interaction is definitely necessary.”

Interactions with instructors were also seen as an important issue in members’ discussions regarding their satisfaction with their DL experiences. There was a range of levels of satisfaction with instructor interactions. Some said that they communicated with instructors through the messages and online forum discussions on the Defence Learning Network (DLN) / Learning Management System (LMS), some via email, and some communicated on the telephone. One member said that they found the interactions with instructors to be “adequate,” and another said, “effective.” One Senior NCM that I interviewed, who had completed the SLP, stated that the course staff were, “always there to help.”

On the other hand, some members felt that the interactions with their instructors and staff left something to be desired. The interaction, one member stated, was “effective but very brief and not necessarily personable.” In terms of feedback, one PLQ graduate hinted at his displeasure saying that it should be made “mandatory for instructors to respond within a given time period.” A Senior NCM stated, in reference to the interactions with instructors, that he was “not overly satisfied… it was more process management than people management.” He suggested this could be improved by “more feedback on how we’re communicating, more feedback on things that we’re doing, greater interactive sessions.” In terms of the online discussions, another member stated that “the instructors could have been involved. They could have actually chimed in, they could have given some feedback directly in the middle of conversations, they could have redirected conversations or opened up the conversations much more,” and that this probably would have, “elicited a little more.”

A Junior Officer who had completed the CAFJOD program explained that “there’s no instructors on CAFJOD” and that the course is, “entirely self-serve.” He stated that any questions a student may have were to be directed to the Chain of Command.

As for interactions with the course content, members reported that, depending on the different courses, they accessed the content in different ways, such as the following: on the LMS, by downloading pdfs or accessing content through provided links and electronic libraries, both from internal and external sources; and, in some cases, through content and references that were either mailed or emailed. One member said that there were “phenomenal resources” that were “easy-to-access.” A JCSP graduate stated that “the content as provided was easily accessible, you could get it, you could read it.”

As you can see, there were a range of levels of satisfaction with the interactions within the CAF Professional Development Programs for Officers and NCMs and I have, obviously, not represented all comments here. The sentiments within, however, generally speaking, were also supported by the quantitative data. In my opinion, many of the issues that were brought up in this research regarding interactions, could be addressed somewhat with the use of the newly available technologies, such as desktop videoconferencing now available to all CAF members. Even at a physical distance, a blended approach including technologies that enable synchronous interactions via, for example, MS Teams or the DLN virtual classroom, and asynchronous, for example, via the DLN LMS, could offer even more opportunities for valuable learning interactions via DL than prior to the COVID pandemic.

As stated in earlier articles in this series, higher quality interactions, in various forms (i.e., learner-content, learner-to-instructor, and learner-leaner) has the potential to lead to a more satisfying learning experience. While, there may sometimes be roadblocks (e.g., bandwidth, Internet access), we should make all attempts to optimize the training technologies available to us to the benefit of our students.

For further information, including the quantitative data of my research in relations to DL interactions, feel free to pursue my full dissertation linked below. More discussions related to this research’s findings, in relation to training technologies and military-specific considerations for DL, will follow in future blog articles.

Reference

Jones, K.A. (2021). Satisfaction of Canadian Armed Forces Regular Fores Members with their Distance Learning Experiences [Dissertation]. Athabasca University.

Doctor of Education Dissertation: Satisfaction of Canadian Armed Forces Regular Force Members with their Distance Learning Experiences

As my first blog post and on the two year anniversary of my successful defence, I am pleased to share with you the synopsis of my doctoral dissertation, along with the link to the full version. I graduated in 2020 with a Doctor of Education degree (EdD) in Distance Education from Athabasca University with a dissertation titled, “Satisfaction of Canadian Armed Forces Regular Force Members with their Distance Learning Experiences.” I will surely have further musings about the results of the research, as well as my own personal learning journey towards its completion, in future posts. I share with you here the synopsis. The link to the full dissertation is also below if you wish to explore more. I also have a shorter summary version (~10 pages) available (upon request) that was published as a scientific letter by the Defence Research and Development Canada (DRDC).

Abstract:

The use of distance learning (DL) as a training and education delivery method has been on the rise within the Canadian Armed Forces (CAF) as a way of optimizing funding to the training system while still maintaining a high standard.  Since research has shown relationships between student satisfaction and various positive outcomes, such as training retention and readiness to transfer learning to the workplace, the satisfaction of CAF learners is an important area of inquiry. This research explored the satisfaction levels of CAF members with their DL experiences, how different variables related to that satisfaction, and how military-specific considerations affected members’ DL experiences. 

This mixed methods research involved a sample of CAF members who had completed, within approximately the past three years, one of seven CAF professional development courses/programs that were delivered via DL or in a blended DL and classroom format.  The study used a two-phase mixed-methods research design that included data collection in the form of an online survey distributed to 1310 CAF Regular Force members, which yielded 368 usable questionnaires, followed by 12 follow-up interviews.   Quantitative data were analyzed using descriptive and correlation analyses, as well as factor analyses and multiple regression.  Qualitative data were analyzed using coding frequency analyses and thematic content analysis, which added depth concerning CAF members’ personal experiences. 

The findings showed a relatively high level of satisfaction, but that given the choice between delivery modes, a much higher percentage of members would choose classroom over DL.  The exploration of demographic, course quality, support, and perception variables in relation to overall DL satisfaction shed some light on potential reasons for these findings.  Recommendations were provided to encourage continuous improvement of CAF DL programs.