June 18, 2026

Fable 5's Cost Gap, AI "Cheating" at Scale, and a 70-Page Handbook in 20 Minutes

Fable 5's Cost Gap, AI "Cheating" at Scale, and a 70-Page Handbook in 20 Minutes
Fable 5's Cost Gap, AI "Cheating" at Scale, and a 70-Page Handbook in 20 Minutes
AI Goes to College
Fable 5's Cost Gap, AI "Cheating" at Scale, and a 70-Page Handbook in 20 Minutes
Apple Podcasts podcast player badge
Goodpods podcast player badge
Overcast podcast player badge
Podcast Addict podcast player badge
Spotify podcast player badge
Castamatic podcast player badge
PocketCasts podcast player badge
Podurama podcast player badge
Apple Podcasts podcast player iconGoodpods podcast player iconOvercast podcast player iconPodcast Addict podcast player iconSpotify podcast player iconCastamatic podcast player iconPocketCasts podcast player iconPodurama podcast player icon

When Better Models Widen the Gap: AI's Cost Divide in Higher Ed (AI Goes to College, Ep. 36)

What happens to students when the best AI models cost ten times more than the basic ones? That is the question Craig and Rob keep circling in this episode, prompted by Anthropic's brief and strange release of Fable 5.

Fable 5 arrived as a guardrailed version of Mythos, a model so good at exposing software vulnerabilities that Anthropic had restricted it to a small set of secure organizations. For about a week it was freely available to paid users; then federal import controls landed and Anthropic pulled it, with no clear word on when, or whether, it returns. The hosts use that whiplash to get at the questions that actually matter for higher ed: who can afford the most capable tools, what that does to learning, and why none of it changes the deeper problem with how we assess students. They also dig into a large new study on student AI use, the agents Rob is building for faculty this summer, and a 70-page course handbook Craig generated in an afternoon.

What you'll hear

The cost gap, in real numbers. Craig walks through Anthropic's tiers (Haiku, Sonnet, Opus, Fable) and what they cost to run: a task that runs free under his Opus subscription would have cost roughly $50 in Fable 5, while Haiku sits around $5. His worry is that this turns into an SAT-prep dynamic on steroids, where score gaps come from resource access rather than ability.

Rob's counterintuitive flip. Rob raises the possibility that students stuck on weaker models might actually learn more, because they cannot offload as much of the cognitive work and have to stay involved in it. Neither host claims to know; they treat it as a real open question.

A large study on student AI use. The hosts dig into a Science paper covering more than 95,000 students across 20 major U.S. public research universities. About two-thirds reported using generative AI in the prior year; roughly 9% of those users said they turned in AI-generated work knowing it wasn't allowed. The inappropriate-use rates run higher in non-STEM fields even though adoption there is lower.

Faculty tools built over the summer. Rob describes agents his student interns are building: a syllabus-comparison tool that flags where a faculty member's syllabus diverges from the new template, an active-learning brainstorming assistant, and an AI-resilience checker for assignments and assessments.

A textbook-grade handbook in an afternoon. Craig recounts handing OpenAI's Codex a couple of syllabi and one-shotting a 70-page course handbook for a freshman business course, then refining the activities. He pledges to release the finished version under a Creative Commons license.

Why the gap is the real story

The Fable 5 saga is good copy, but the hosts keep pulling it back toward something more durable. When the most capable models cost an order of magnitude more than the entry-level ones, the divide isn't only between rich and poor institutions; it reaches into a single classroom, where one student on a free model and another paying for the frontier model are turning in work that no longer means the same thing.

Craig's answer isn't to chase the frontier. It's to teach students to match the model to the task; you don't pay for the expensive employee to do routine work, and you don't burn Fable 5 on something Haiku can handle. Rob extends the point to policy: banning AI outright is folly, both because it's nearly impossible to detect without introducing bias and because it leaves you with a classroom where you have no idea who learned what. Craig demonstrates the detection problem directly, running lightly edited AI text through Pangram and getting a "100% human" verdict. The shared conclusion is one they've made before and make again here: the urgent work is assessment reform, because a graded artifact is no longer a trustworthy signal of what a student actually knows.

Episode highlights

  • (12:11) Rob on weaker models and learning: "I wonder if the people who aren't using these highly capable models might actually learn more, because they're not going to be able to cognitively offload as much of the things that they're doing, and they'll need to be more involved in it."
  • (15:51) Craig on Anthropic's rollout: "Anthropic really came off like a drug dealer that gives you a little taste before they try to get you hooked."
  • (20:01) Craig on the study's central finding: "About 9% of those users turned in AI-generated work knowing it wasn't allowed."
  • (26:31) Craig on why assessment has to change: "It's no longer a trustworthy signal of what they know if we keep doing things the way we've been doing them."
  • (37:21) Craig on the AI-built handbook: "It was a 70-page handbook with learning activities; good, not great, in about 20 minutes."
  • (45:31) Craig's top tip: "Handoff documents and memos will make your life so much easier when it comes to AI."

References mentioned

  • Anthropic's Fable 5 and Mythos models. Discussed as a guardrailed public release (Fable 5) built on the restricted Mythos family, later pulled following federal import controls. (Link to Anthropic announcement / status page: see "What I need from you.")
  • Study on student generative-AI use in Science (data collected 2024). (Full citation and DOI to be provided: see "What I need from you.")
  • Pangram: AI-text detector Craig used to test a lightly edited, skill-generated draft. (Link: see "What I need from you.")
  • OpenAI Codex: GPT-based coding agent Craig used to generate the course handbook.
  • Skills in Claude / Cowork and Microsoft Copilot: discussed as reusable, callable tools for tasks like generating active-learning activities.
  • Van Slyke & Crossler textbook (with co-author Franz Boulanger): referenced as a point of comparison for AI-assisted content creation. (Title / link if you want to include it: see "What I need from you.")

Questions to consider

  • If two students submit work produced with very different models, are you assessing their learning or their access?
  • Where in your own courses is a graded artifact still a trustworthy signal of what a student knows?
  • What's one tedious faculty task this summer that an agent could take off your plate?

AI Goes to College is a podcast for higher education professionals trying to make sense of artificial intelligence in their classrooms, their research, and their institutions. Co-hosted by Craig Van Slyke and Rob Crossler, the show focuses on practical, evidence-based perspectives on AI in higher education without the hype.

Subscribe and follow: https://www.aigoestocollege.com/follow ·

Newsletter: https://aigoestocollege.substack.com/

Links

Science article

Chirikov, I., Smirnov, I., & Kizilcec, R. F. (2026). Generative AI use and misuse call for assessment reform in higher education. Science, 392(6800), 818-820.

https://www.science.org/doi/10.1126/science.aec5115

Anthropic Fable 5/Mythos announcement

https://www.anthropic.com/news/fable-mythos-access

Pangram (AI "detector")

https://www.pangram.com/

Information Systems for Business: An Experiential Approach (Belanger, Van Slyke & Crossler)

https://www.prospectpressvt.com/textbooks/b%C3%A9langer-information-systems-for-business-an-experiential-approach-5-0

Chapters

00:00 - Untitled

00:41 - Untitled

00:42 - Introduction to AI in Higher Education

09:25 - The Growing Divide in AI Access and Education

10:20 - The Impact of AI on Learning Outcomes

20:46 - The Role of AI in Higher Education Assessment and Faculty Development

34:01 - Customizing Education with AI

38:24 - The Importance of Handoff Documents and Theoretical Memos

Transcript
Speaker A

Welcome to another episode of AI Goes to College, the podcast that helps higher ed professionals figure out just what in the world is going on with generative AI.

Speaker A

I'm joined once again by my friend, colleague, and co host, Dr. Robert E. Crossler from Washington State University.

Speaker A

Rob, it's hot here.

Speaker A

What about up there?

Speaker B

We are starting to warm up.

Speaker B

We crested 80 degrees yesterday, Craig.

Speaker A

We're actually below 80 at the moment, but that will not last.

Speaker A

Okay, let's get right to it, because we've got a lot to talk about today.

Speaker A

Today.

Speaker A

Rob, you want to start us off?

Speaker B

Yeah, Craig.

Speaker B

It's been an interesting news cycle lately.

Speaker B

Anthropic dropped Fable 5, which was related to Mythos, which wasn't allowed to be released, and they scaled that back, releasing Fable 5.

Speaker B

And it's been available.

Speaker B

Not available, difficult to be available, expensive, capable, all sorts of interesting things around that.

Speaker B

So I'm curious if you've had a chance to play with that and what your thoughts are.

Speaker A

I did have a chance to play with it.

Speaker A

So for those of you who might not know, Mythos was this model that Anthropic came out with that was so good at exposing, primarily at exposing vulnerabilities, that they did not release it to the general public.

Speaker A

It was released to a very small number of highly secure organizations not long after the hype over meet them Mythos, they came out with Fable 5, which was just a guardrailed version that's driven by the models in the Mythos family.

Speaker A

So there was a lot of hype about this.

Speaker A

Apparently, for coding in particular, it was phenomenally good.

Speaker A

I mean, not just good, but, like, blowing people away.

Speaker A

Good.

Speaker A

I used it, and it was good.

Speaker A

They were making it freely available at the time through June 22, to, I think, at least paid users.

Speaker A

I don't know if free users.

Speaker B

Just for context, Craig, we're having this conversation on June 16th.

Speaker B

So freely available to almost a week from yesterday,.

Speaker A

Until the federal government placed import controls on it and Anthropic pulled the model.

Speaker A

It was interesting.

Speaker A

I got up really early in the morning.

Speaker A

I got up, was using Fable, and then I wasn't using Fable.

Speaker A

And it's like, what's going on?

Speaker A

I thought, it's Claude down.

Speaker A

And then I went and tried a different model, and that worked.

Speaker A

So I went to their status page and said it was unavailable, and then I got a message that said, it's temporarily unavailable in the clawed app, but apparently there's this import control restriction that was placed on it for reasons that are still very murky.

Speaker A

And so Claude just pulled it because they didn't have a way figured out to restrict it to users of only certain countries just yet.

Speaker A

So we'll put some links in the show notes about this, but I was pretty impressed with my usage and I think it's really good for highly complex multi step reasoning based operations like going through a code base, a bunch of computer code and saying here's a security vulnerability, here's an inconsistency in the code that's really hard to do because it involves a lot of steps, a lot of back and forth and it was quite good at that.

Speaker A

And so then they pulled it.

Speaker A

No word on when it will be back.

Speaker A

I've been watching Reddit and some other spaces and it's everything from tomorrow to never from all the experts that don't really know anything and so we don't know when or if it will ever come back.

Speaker B

Yeah, and some history with Anthropic just for people who aren't following this, it'll be interesting the politics of AI because I think it's going to drive a lot of what happens as capabilities increase, whether it's export controls or we only want something developed in our country, used within our country.

Speaker B

The Pentagon was aligned with anthropic for a while.

Speaker B

Ultimately Anthropic didn't like how the federal government was going to use their product.

Speaker B

And so some relationships changed and OpenAI became the AI flavor for the US government.

Speaker B

So there are a lot of tensions between these different companies and governmental agencies that just color this whole conversation.

Speaker A

Yeah, the conspiracy sphere is having a lot of fun with this one.

Speaker B

This is where I think about conversations in the classroom with students.

Speaker B

It's not about using AI in these conversations, but from an organizational perspective.

Speaker B

As you are looking for these different tools to use, how do you decide which ones you're going to license and utilize?

Speaker B

What are the pro and con analyses?

Speaker B

Where are you going to get your best return on investment?

Speaker B

There's a lot of really interesting conversations around decision making in this emerging technology space where prices are changing regularly, capabilities are changing regularly, there's geopolitical arguments happening regularly.

Speaker B

It creates a really interesting space to have some real time.

Speaker B

What would you do in these situation type conversations?

Speaker A

I don't want to go too far down this path because it's only tangential to higher ed, but models are being built off of models.

Speaker A

And so if this is a supermodel, not that kind of supermodel, if it's a super capable model, that really moves the bar on what that Means other entities, often state actors, can take these models, decompose them, do all kinds of technical stuff to create their own models.

Speaker A

And so there's some real.

Speaker A

I don't know whether what the government's doing is legitimate or reasonable, who knows?

Speaker A

But you can paint a picture where it's pretty reasonable to not allow this out into the public.

Speaker A

But let's for the moment say this all gets figured out and we get Fable 5 back.

Speaker A

My big concern is we are going to create an even bigger gap between the haves and have nots.

Speaker A

Let me just give you some numbers.

Speaker A

Claude's models are, in terms of their tiers are Haiku, Sonnet, Opus and Fable.

Speaker A

In terms of their capabilities and more importantly, their expense.

Speaker A

I usually use Opus 4.8, something that if I was paying for it through credits and not through a subscription, that would cost me about $25 to run.

Speaker A

An Opus 4.8 would cost me about $50 in Fable 5.

Speaker B

So it's about twice as expensive, Is that what I'm hearing?

Speaker A

It's roughly twice as expensive.

Speaker A

And you can go get this data from Anthropic Haiku would be about five bucks.

Speaker B

So 10% of the cost of Fable 5.

Speaker B

So we're looking at a significant increase from their lower end, very accessible models to these super capable models that are hitting the market.

Speaker A

And what made this even more interesting is until June 22nd, at the time, you didn't have to pay extra to run Fable 5.

Speaker A

It would drain your quota faster, but you didn't have to pay extra for it.

Speaker A

You just couldn't use it for some period of time until your quota reset.

Speaker A

But after June 22, they were going to start charging usage credits, which roughly translate into what I just talked about with the costs.

Speaker A

And so here's where it gets problematic.

Speaker A

After June 22, let's say I wanted to write a lit review.

Speaker A

They're doing annotated bibliography, which is, I do a lot of annotated bibliographies with these tools.

Speaker A

If I ran it under Opus 4.8, it cost me nothing.

Speaker A

It's included in my.

Speaker A

I have $100 subscription, but it would work under a $20 subscription.

Speaker A

I'd have to pay 50 bucks to do that with Fable 5.

Speaker A

Well, you know, if you're at a big, heavy, Ivy League, high end research school, maybe that's not a problem.

Speaker A

Or if you're a rich kid, maybe that's not a problem.

Speaker A

If you're a kid from a poor background, less well resourced background, or you're at A less well resourced institution, all of a sudden you can't do that, which means you have lower capabilities versus these other institutions.

Speaker A

And that gap is just going to widen and widen and widen.

Speaker A

I think that's a serious concern that I have not heard anybody talking about yet.

Speaker A

But I think we need to.

Speaker B

Right.

Speaker B

And to put that into the perspective of the classroom.

Speaker B

Right.

Speaker B

Because the research argument, I think we're going to see some really interesting things around research and the number of manuscripts that are being submitted, especially as AI tools allow for people to quickly do things in ways that they've not been able to before.

Speaker B

But if I'm in the classroom and one student has access to the free model of Claude and another student invests in Fable 5, the disparity between what they're creating to turn in with these tools is going to be huge.

Speaker B

And so it really forces you to look at assessments in a way to ensure that someone's not going to be penalized in their learning outcomes and learning assessments just because of capabilities of AI models.

Speaker B

And I'm not certain what those solutions look like, but it should cause us to pause and say, how does the existence of these tools impact the learning outcomes that we're looking for with our students?

Speaker A

I agree with everything you just said, but it's even worse.

Speaker A

It's the ability to learn.

Speaker A

We saw this when it became the norm to get GMAT and GRE and SAT and ACT prep courses back in the day.

Speaker A

You might get a book and that was it.

Speaker A

And most people could afford to buy the book or you get a book from a friend who took the test before.

Speaker A

But then it became these tutoring centers that would do the prep.

Speaker A

And we started to see this separation in test scores not because of innate ability, but because of resource availability.

Speaker A

It's going to be like that on steroids, I'm afraid.

Speaker A

So we need to be ready for this because it may not be Fable 5 that comes back, but it's going to be GPT 5.6 or, you know,.

Speaker B

Whatever, Craig, I'll push that in a little different direction.

Speaker B

I wonder if as people begin using these more highly capable models versus those who aren't, if the people who aren't using these highly capable models might actually learn more because they're not going to be able to cognitively offload as much of the things that they're doing and they'll need to be more involved in it.

Speaker B

So I wonder if learning will actually be increased with the more simplistic models than the more advanced models.

Speaker B

And it might actually be a more useful tool for a learning perspective.

Speaker A

It could be.

Speaker A

We just don't know.

Speaker A

But that's a reasonable projection.

Speaker A

So there's another higher ed angle that's not being talked about.

Speaker A

God, that sounded like AI wrote that.

Speaker A

Here's the story no one's talking about.

Speaker A

So I was thinking a lot about this with my own use, and then how I'm going to help my students think about it as well.

Speaker A

I think of Fable 5 as being the really expensive employee.

Speaker A

So you don't need somebody that's making a couple hundred thousand dollars a year to do routine work.

Speaker A

And so you don't use Fable 5 to do something that haiku can do.

Speaker A

So one of the things we're going to have to help students understand is how to match model capabilities to the task.

Speaker A

And that's something that really isn't being taught in any widespread way that I know of, but it's one of the things that can help us mitigate not only the resource effects, but also the learning effects.

Speaker A

You know, if you're really stuck and need an expert tutor to help you get unstuck, Maybe it's worth Fable 5 if you just want to check your understanding of some basic concept.

Speaker A

Maybe haiku is enough to tell you, nope, you don't quite have this right, or you got it.

Speaker A

So I think it's a direction we're going to have to go sooner rather than later, as if we needed something else to do, but there you go.

Speaker B

Well, and I think this all points towards Craig having opportunities, as we're teaching classes, to engage with the news of the day.

Speaker B

And what does that really mean?

Speaker B

Because if I sat back and designed a class today to address these things we're talking about on this episode, by the time I get to late August, early September, when my class is being delivered, what I designed today is probably going to be different than what I would design in September.

Speaker B

So being able to bring in just kind of live case studies, if you will, or live news assessments, and what does it mean?

Speaker B

How does this force us to think differently is going to be, I think, a crucial tool that we utilize within higher ed.

Speaker A

And that's just one more thing that faculty will have to do, is they're going to have to stay up on some of these developments, which is why they should listen to AI Goes to College.

Speaker A

And remember, you can do that by going to aigostocollege.com if you want to follow us.

Speaker A

It's AI goes to college.com follow all the major podcast apps are one click maybe two clicks to subscribe from there.

Speaker B

That's a nice segue into that Science article that we both read this week talking about AI misuse or students cheating with AI.

Speaker B

I'm very hesitant to call what the students did cheating per se, but that's how the article referred to it.

Speaker B

And what does that tell us about students and what they're using?

Speaker B

Can you talk about that article a little bit, Craig?

Speaker A

Yeah, this came from Science.

Speaker A

It was a massive study.

Speaker A

More than 95,000 students across 20 major public research universities in the US.

Speaker A

It just came out in May.

Speaker A

The authors were Chirikov, Smirnoff and Kizilek.

Speaker A

I can't pronounce that one, but there will be a link in the show notes.

Speaker A

And they were out of Cal, Berkeley, Cornell and University of Technology, Sydney.

Speaker A

And it's just so huge.

Speaker A

That's enough reason to pay attention to it in and of itself.

Speaker A

So here are kind of the big findings.

Speaker A

Their methodology was interesting because they didn't just ask, did you cheat?

Speaker A

They asked some kind of masking questions.

Speaker A

I think they asked like four or five questions, and one of them was about, did you cheat?

Speaker B

And they didn't actually ask, did you cheat?

Speaker B

They asked something to the effect of did you utilize AI in a way that wasn't allowed.

Speaker B

So they weren't actually asking the did you cheat?

Speaker B

Sort of question.

Speaker A

Yeah, they weren't quite that blunt.

Speaker A

So 2/3 of the students surveyed used generative AI in the past year.

Speaker A

The highest disciplinary areas in terms of usage were in stem.

Speaker A

Not a big surprise.

Speaker B

And this data was collected in 2024.

Speaker B

So this is two years ago.

Speaker B

This is how much people were using it.

Speaker B

I would argue if they did the same study today, we would see the numbers increased.

Speaker A

Yeah.

Speaker A

Although I'm always a little bit hesitant to read too much into this because there's using AI and then there's using AI.

Speaker A

I mean, I use AI, you use AI.

Speaker A

There are a lot of people that use AI.

Speaker A

So all usage is not the same, but still, it's a useful statistic nonetheless.

Speaker A

But about 9% of those users turned in AI generated work knowing it wasn't allowed.

Speaker A

No surprise.

Speaker A

The misuse is concentrated among daily users who cheat at four times the rate of monthly users.

Speaker A

Although wouldn't if that was proportional, wouldn't it be 30 times the rate?

Speaker A

So I'm not sure how to interpret that the inappropriate use runs higher in non STEM fields, even though the adoption there is lower.

Speaker A

There's a lot to look at here and a lot that they really don't get into in the paper that I think is worth discussing.

Speaker B

Just for the record, this paper is three pages long, so it's very much more about what did they do, what did they find with a few recommendations for what does this mean for or academia.

Speaker B

It was not a 30 page paper filled with all sorts of theory and suggestions and those sorts of things, which is pretty typical for a science article.

Speaker A

Although in an interesting aside, they have an addendum that's really long that goes into all the details if you want to dig into those.

Speaker A

But to your point, yeah, it's not hard to just get this paper and read it for yourself.

Speaker A

So 62% of computer science students reported using generative AI versus 24% in the arts.

Speaker A

Business and economics were right at 50% each.

Speaker A

So it's not really the STEM, non STEM.

Speaker A

Although business is so broad, some of it morphs towards STEM if you look at finance and information systems.

Speaker A

So it's a little bit of a blurry line.

Speaker A

What I found kind of interesting is this mix of inappropriate use and usage rates.

Speaker A

There's a giant figure in the paper where, for example, computer science, over 60% reported using AI, around 10% reported using it inappropriately as opposed to if we look at journalism, what looks like about 16% used it inappropriately versus about 36%.

Speaker A

I'm reading off of a chart, so I'm estimating these a little bit using IT overall.

Speaker A

So that's a huge proportion of the users that use it inappropriately relative to computer science.

Speaker A

Business was kind of in the middle.

Speaker B

I wonder, Craig, how many of those numbers reflect disciplines that we're more willing to adopt, that it's okay to use these sorts of things, because I know a lot of computer science science programs are becoming AI programs and have realized that they need to be adopting this and utilizing this.

Speaker B

I do wonder how much of that reflects it.

Speaker B

Where I talk to my marketing communications colleagues and they live in a world that appreciates more the human nuance to writing and the importance of that.

Speaker B

And so there's different views on what's allowable and not allowable in some of these disciplines.

Speaker A

Well, I think it's not just that you hinted at this, it's the maturity of AI use in those areas.

Speaker A

So you and I and the computer science folks and some others since almost the beginning of the ChatGPT public release have been trying to figure out all of this and how to deal with it, because our students were going to be the ones that grabbed onto it first, because that's what they do.

Speaker A

They're technology folks.

Speaker A

And so we've had to wrestle with this and maybe we've drawn the lines a little more clearly for students, but that's all speculative.

Speaker A

What I think this points at, maybe more importantly, is what it has to say for policy implications.

Speaker A

Rob, you're a big policy guy.

Speaker A

What do you think?

Speaker B

Yeah, I think to ban AI as a flat policy is going to create a world where more and more of this is going to happen and we're not going to be able to enforce it because it's nearly impossible to detect, at least without bringing in biases and different things.

Speaker B

So I think open communication about how to use it, where to use it, and being more nuanced in how you define the appropriate way it's used in the class and in higher education settings is going to be crucial.

Speaker B

Because if you try to put your head in the sand and just say you can't do it, you're probably going to have a classroom space where you're not sure who has learned what at the end of the day.

Speaker A

Yeah, I mean, that's always been folly to ban it.

Speaker A

Quick story.

Speaker A

I used AI to write something using one of my write like Craig skills, spent about two minutes editing it, put it into Pangram, which is one of the better AI detectors, 100% human generated.

Speaker A

So with just a little bit of skill and effort, it's pretty easy to get around these AI detectors.

Speaker A

And then there are all kinds of other problems.

Speaker A

We don't need to get into that.

Speaker A

But I think this is just one more indicator of what you said about policy, but also the need for assessment reform.

Speaker B

And one of the things that I read in this article was the need to invest in faculty development.

Speaker B

And I absolutely agree that faculty need to figure out how to do these sorts of things.

Speaker B

But I also know that higher education has never been terribly great at investing heavily into faculty development.

Speaker B

It's a learn as you go experiment.

Speaker B

If nothing, we need to create a safe space for faculty to be able to experiment with what they're doing purposefully, and a space where faculty can share with each other what they're learning.

Speaker B

So that way we're not all reinventing each other's creations and various different things.

Speaker B

How can we create this space where we grow together in a meaningful, purposeful way?

Speaker A

Although that's one of those that's easier said than done sometimes.

Speaker A

But to me, the bottom line here, it's not just the interesting mix of inappropriate use versus use.

Speaker A

I mean, that's interesting, but the big deal is that We've got to change how we do assessment because it's not just that students cheat or can cheat, it's that it's no longer a trustworthy signal of what they know if we keep doing things the way we've been doing them.

Speaker A

So that's a big job.

Speaker A

But we've been saying this for the entire time we've had this podcast we have to get after this.

Speaker B

And I would say if you're doing nothing else this summer, this is a space where you've hopefully got some free time to think about what this looks like without the day to day grading and different things that may get in the way that make it hard during the academic year.

Speaker B

So give yourself the freedom to step aside and maybe work with a colleague to see what is possible.

Speaker A

All right, my turn to segue.

Speaker A

Rob, you're doing some things to help ease some faculty time burdens over the summer.

Speaker A

Tell us about it.

Speaker B

So we've got a couple of student interns working for us in the college that I'm giving them some ideas that have been in my head and helping them develop some AI tools that I think will be helpful for faculty.

Speaker B

The first one that I've been toying with, and we're probably about 80% of the way there with what this is going to do, is to take what was our syllabus template and this goes out to faculty over the course of the summer and there's updates or changes to what needs to be in the syllabus.

Speaker B

Kind of the whole premise is here's what the new template looks like.

Speaker B

Please compare it to your existing syllabus and make sure that you're communicating things in the way that we hope you would from a university or from a college's perspective.

Speaker B

And one of the things that I've always, I guess, hated about it is it's pretty tedious, pretty time consuming to sit and take my five page syllabus or however long the syllabus is, and look at what's new or different or changed in a syllabus.

Speaker B

That's the new template and what do I need to change and where is it at?

Speaker B

And so to create a syllabus template agent which will help faculty can upload their syllabus to it and it will pop out.

Speaker B

Where are the places that a you've got alignment so it gives some positive reinforcement for places where it matches and then where it's not aligned with what the template looks like it give for how to update and where to update and make those changes.

Speaker B

So it takes that human comparison process out and allows for the faculty to very quickly and easily find places where they might need to make some changes.

Speaker A

I have an unfair question for you.

Speaker A

First of all, that's a great use because you said tedious.

Speaker A

It's mind numbingly boring.

Speaker A

But are you going to use this to evaluate.

Speaker B

No, I don't plan on it.

Speaker B

We're not going to store people's syllabi and we're not going to evaluate them.

Speaker B

I want to keep the AI space a trustworthy where it's helpful and not seen as evaluative.

Speaker B

I look at this truly as a tool that puts the human in the loop to change their syllabus as they need to.

Speaker B

One of my fears is, are you just going to have it write people's syllabus for them?

Speaker B

Which would be nice, but I would be afraid that we'd have a syllabus that the faculty didn't know what was in their own syllabus, and it would create potential problems down the road.

Speaker A

Well, although I want to push back on that a little bit.

Speaker A

So what if.

Speaker A

If it created the syllabus 80% of the way or 75% of the way?

Speaker A

I mean, that's kind of what we do, right?

Speaker A

Most schools have all this syllabus language that's got to go in there, and it may or may not have a standard format, but you've got to have these different elements and you've got to have these different policies and all that kind of thing.

Speaker A

I mean, if it can write that 75% of the way there.

Speaker B

Yeah.

Speaker B

And one of the ideas I'm toying around with once we get the comparison tool made is what if I tweaked the agent to have it ask a series of questions like what's your name?

Speaker B

Where your office located?

Speaker B

What are your office hours?

Speaker B

And from some prompts it would.

Speaker A

What is your question?

Speaker B

What is your question?

Speaker B

Some Monty Python Holy Grail in there, perhaps, but through some prompts and some questions that it would actually create exactly what you're saying might be a version B of this, but for now, a comparison tool is where we're starting.

Speaker A

Well, I think I mentioned this, but I'll tell you what something like Codex or Claude Code Cowork is really good at is updating your syllabus.

Speaker A

I mean, I always screw up some date because I miss a holiday or, you know, delete a row or something like that.

Speaker A

And it's really good at going through and doing all that kind of thing.

Speaker B

So another tool that we're making is around active learning and giving people an opportunity to a upload activities they might already be doing to give them some feedback and some suggestions for how they might incorporate that into a more active learning, engaged approach, or even uploading things like the PowerPoint slides they'd be using and say, how could I turn what might be a death by PowerPoint approach to teaching to be more active engagement getting to those same learning outcomes.

Speaker B

So really a tool to help brainstorm.

Speaker B

Kind of the same way I've used AI to help me do these exact same things with my own prompting, but to bake those into a tool where it's just, here you go, give me some suggestions.

Speaker B

And then helping to develop new ways of approaching those learning activities in the classroom.

Speaker A

Are you using Copilot?

Speaker B

I am for this, Yep.

Speaker A

So does Copilot have skills like Claude and Cowork?

Speaker B

It does.

Speaker A

That's something I really think people ought to investigate more.

Speaker A

They're really flaky in ChatGPT, but they work very well in Claude.

Speaker A

But you could pretty easily create an active learning skill where you could take some set of learning objectives, give it a little bit of context, and have it create a library of learning activities.

Speaker A

Just a little bit of an aside.

Speaker A

People should investigate skills because they're really, really useful and you can call them from within any conversation as opposed to something like a custom GPT or an agent where you have to be engaging with that thing first.

Speaker A

You can be in some random conversation and invoke a skill.

Speaker B

Yeah, I like that idea.

Speaker B

And then the one last thing that I haven't started working on that's on my radar is an AI resilience detector to help people, to have a partner to help them look at the activities, the way they're grading, the way they're doing assessments, and to give feedback for how this holds up in a world where AI exists.

Speaker A

Yeah, that could be huge.

Speaker A

You should make that one publicly available and help all of us.

Speaker A

Those seem like they're very useful and great ways.

Speaker A

I don't know if this was your intention, but great ways to help faculty see the potential, even if they're reluctant adopters of AI.

Speaker A

If you give a faculty member this AI tool and said, look, I know you don't like AI, but if you put your syllabus through here, it's going to save you an hour of reviewing your syllabus, yeah, that's a pretty high relative advantage.

Speaker B

So, yep, that's the goal.

Speaker B

One of the things that I think is important as we think about encouraging people to adopt AI into their roles is to not say this is what you have to do, but to say, here's some tools that can help you think about how to achieve what we're all trying to do, which is to ensure our students come into our classro learn what we hope they would learn in our classroom.

Speaker A

I thought what we were all trying to do is avoid committee work, but I'll go with yours too.

Speaker B

Maybe I could create an app that'll help us.

Speaker A

That's another strong contender.

Speaker B

Do our committee work for us.

Speaker A

There you go.

Speaker A

Virtual Rob.

Speaker A

Associate Dean's meetings.

Speaker A

I'm going to throw you a little bit of a curveball, Rob, because we're talking about agents.

Speaker A

Quick backstory.

Speaker A

We have a class, CIS125.

Speaker A

We started renumbering, so now it's 125 3.

Speaker B

So when you say we, Craig, you're talking about.

Speaker A

Oh, Louisiana Tech.

Speaker A

Sorry, sorry.

Speaker A

Pronoun reference problem.

Speaker A

Yes, Louisiana.

Speaker A

I dated an English major once that said pronoun reference to me an awful lot.

Speaker A

So this CIS125 class, all the freshmen in business school, a lot of freshmen from across the university take it and it's kind of Excel and some other stuff.

Speaker A

Not just hands on, but a big hands on component.

Speaker A

Well, there's a lot of institutional pressure to integrate generative AI in that course and we've done that to some extent, but we need more.

Speaker A

So I was thinking about this problem and thought this seems like a good task for an AI agent.

Speaker A

So I gave it to Codex, which is C O D e X.

Speaker A

That's OpenAI's GPT based coding agent.

Speaker A

We've talked about that before on the show.

Speaker A

I gave it a couple of syllabi from the course, explained what I wanted to do, set some parameters, gave it some context and said write this handbook for me.

Speaker A

And I literally one shotted it.

Speaker A

We had a little conversation back and forth and I said I don't want to do this chapter by chapter.

Speaker A

I want you just to write this thing.

Speaker A

And it was good, not great.

Speaker A

In about 20 minutes it was a 70 page handbook with learning activities.

Speaker A

We shaped it around skills here.

Speaker A

Like I can't remember, it was four or five skills related to AI.

Speaker A

It tied it into the classroom.

Speaker A

Like there's a heavy Excel component.

Speaker A

This is how you use AI to help you with spreadsheet based problems, that kind of thing.

Speaker A

I wasn't happy with some of the activities, so went back and forth on how to clean up the activities and in another half an hour or so had a much better Handbook that frankly, if we just gave it to students, it'd be fine.

Speaker A

But I think with a little bit more work where the human comes in with some true refinement, it could be a pretty substantial learning resource for our community.

Speaker A

But think about that.

Speaker A

You and I with Franz Melanger have a pretty successful textbook, but when Franz and I wrote the first edition, we spent like a year and a half on this thing.

Speaker A

Now, what Codex created isn't up to that level, but it's a big head start.

Speaker A

I mean, it would have cut a half a year off at least easily.

Speaker A

So I think people need to be thinking about, can you do a bespoke textbook?

Speaker A

Or in this case, it doesn't replace the textbook, it's a supplement to it that's really necessary.

Speaker A

So I don't know, Rob, what's your reaction to that?

Speaker B

I think it's one of those things that begins to change the world of knowledge creation.

Speaker B

So if we can do this with textbooks, all of a sudden can have very customized classes.

Speaker B

I know a lot of times I can speak to the MIS curriculum, but I would imagine this is true for most every class is what you do in a particular class is aligned with one of three or four major textbooks that put the chapter by chapter of what you're going to do during that semester.

Speaker B

So degree at Washington State University in MIS may be very similar to one at Louisiana Tech because we've adopted similar textbooks that take similar approaches to teaching these topics.

Speaker B

Well, in a world where we can very easily make books this way, we could customize and tailor what is the flavor at Louisiana Tech versus the flavor at Washington State University and begin to have less similar courses based on whether it's the needs of the states we live in, who are hiring our students and the different employers there, or even what pathways are we setting students up for their graduate school experiences or wherever their life is going to take them.

Speaker A

Yeah, the nuances of the curriculum, you know, we have different course flows and that sort of thing.

Speaker A

And the student body, you know, Washington State and Louisiana Tech probably have some differences.

Speaker A

So yeah, it's early days, but it's pretty intriguing to be able to do something like that, to plug a hole.

Speaker B

Well, and the other thing I would say is, Craig, because you created that the way you did, it's no longer somebody else's resources, so you could build class agents and tutors and bots around that very thing because you're beginning to own that knowledge content and what you've created.

Speaker B

So it's, yeah, really potentially paradigm changing.

Speaker B

For how we approach the classroom experience.

Speaker A

Absolutely.

Speaker A

And I will make this commitment right now.

Speaker A

When that is finished, I will make it freely available under a Creative Commons non Commercial Attribution License or whatever.

Speaker A

That one is like 10 of them.

Speaker A

So, yeah, it was kind of scary.

Speaker A

I want to close with a couple of pro tips, Rob, that I've kind of developed over time and experience.

Speaker A

Those are the handoff documents and what I call theoretical memos, but a normal person would just call memos.

Speaker A

So two problems that I've continually faced using AI is I need to move from one conversation to another conversation, whether I'm running out of context window or I want to use ChatGPT on something I've been talking to Claude about or whatever it might be.

Speaker A

So I've started creating handoff documents, and I literally just say, I need to move this to a different conversation.

Speaker A

Please create a handoff document that will give this new conversation all of the context it needs to pick up from here.

Speaker A

Just something that simple.

Speaker A

I usually ask for it in markdown format, which is one that uses tags to do the formatting because it's really small.

Speaker A

But if I wanted to make it look prettier, I could.

Speaker A

They're easy to copy and paste into a Google Doc.

Speaker A

There's actually, if you right click.

Speaker A

If you've got this enabled, you right click paste for Markdown.

Speaker A

It comes in nicely.

Speaker A

They are insanely useful because, you know, it's just sometimes you just need to move to a different conversation.

Speaker B

So, Craig, when you use these, do you allow any of your tools to connect to Google Drive?

Speaker B

So then it could actually look through a folder on Google Drive to tell you things as well?

Speaker A

Yeah, although that's really spotty in my experience.

Speaker A

I just used Gemini baked into Google Drive.

Speaker A

I haven't shared this with you yet.

Speaker A

To give us a list of everything we've talked about so far on the podcast, because frankly, I lose track.

Speaker A

We're setting up the episode notes for the next episode.

Speaker A

It's like, I don't know, did we talk about this, or did we just talk about talking about this, or did I just think about talking about this?

Speaker A

And so it was pretty useful and it did a good job of that.

Speaker A

But you can connect these.

Speaker A

I think all of them have a Google Drive connector.

Speaker A

But even if you don't want to save the handoff documents, it's really good just to copy and paste it over to a new topic.

Speaker A

I save them because they're so small.

Speaker A

To quote Animal House, another great movie, it don't cost nothing to save it.

Speaker A

So I just save it.

Speaker A

The other problem I've always had using AI is I forget what I've done.

Speaker A

I'll have this great conversation.

Speaker A

I'll go down a different path, or a dog will bark, or I get a phone call or a text message or an email, and then I come back an hour later or two days later.

Speaker A

It's like, no idea what we were talking about.

Speaker A

Now I've got to scan through this whole thing if I can find that chat session, because I also forget to rename them into something useful.

Speaker A

It's just a pain.

Speaker A

So I started doing theoretical memos.

Speaker A

So this comes out of qualitative research.

Speaker A

When you have some insight, you're supposed to create a theoretical memo.

Speaker A

Any normal person would just call it a memo.

Speaker A

And so as the name implies, these are fantastic for memorializing an important chat or an important idea.

Speaker A

So when I get to something I want to make sure I remember.

Speaker A

I say, write a theoretical memo about this.

Speaker A

And I might say about this last, turn on the conversation or this last concept so it doesn't bleed over into early stuff.

Speaker A

I usually ask it to add a date to the memo title, the file name, so I can find it later.

Speaker A

I use markdown again because it's easy.

Speaker A

But this is my number one tip for anybody who's using AI more and more and more and finds themselves forgetting stuff.

Speaker A

I call them theoretical memos.

Speaker A

Whatever, put them into Google Drive.

Speaker A

Google search is so good within Google Drive that it makes it pretty easy to find these things later.

Speaker A

Any of you who are out there listening to this handoff documents and memos will make your life so much easier when it comes to AI.

Speaker B

Now that sounds like a great skill even to work with our students on as they begin using more and more of these entering the workplace and those sorts of things is how do they keep their productivity up without having to go, have I done that already?

Speaker B

Or am I hallucinating that I even did that?

Speaker B

That thing?

Speaker A

You'll love this.

Speaker A

When I was talking about all of this and creating one of These memos, either ChatGPT or Claude said, well, this will help keep people from.

Speaker A

How did it say it?

Speaker A

Having all of these disconnected facts in a big idea garbage can that never goes anywhere towards doing something productive.

Speaker A

I said, you've just described my entire academic life, this big giant garbage can of these interesting ideas that I never do anything with.

Speaker A

It's like, oh, that was depressing, humbling, and scary all at the same time.

Speaker A

So, Rob, I think we should end on that note.

Speaker A

Do you have anything else?

Speaker B

I don't, Craig.

Speaker B

I'm not going to add anything to your garbage can.

Speaker A

All right.

Speaker A

Well, thank you very much for joining us.

Speaker A

Join us again next time on AI Goes to College.

Speaker A

Remember, everything AI Goes to College is available@aigostocollege.com and we will see you next time.

Speaker A

Thank you.