Skip to content

← Grade 10 Computer

Multimedia

Unit 3 · CDC textbook pages 81–140

Hide the stories, facts, photos, activities and interactives, for revising before an exam
In this unit 8 sections
  1. Introduction: what multimedia is
  2. Applications of multimedia
  3. 3.1 Text
  4. 3.2 Graphics
  5. 3.3 Audio
  6. 3.4 Video
  7. 3.5 Concept of animation
  8. Exercise

Think of the last thing you learned from your phone. Perhaps a video of a teacher solving a sum, with her voice explaining each step, the numbers written on the screen, and an arrow sliding across to show where the 7 goes. Or a map that turned into a 3D picture of the mountains around Pokhara when you tilted it. None of that is one kind of thing: it is words, pictures, sound, moving film and animation, joined together so that each does the job it does best.

That joining is called multimedia. In this unit you find out how a computer stores each of these as numbers, why a photo is saved one way and a logo another, what the wiggly line in a sound editor means, and why a video can be smooth or jerky, sharp or blurry. Then you make some yourself: a poster in a graphics editor, a recording in an audio editor, and a short video, the way professionals do, step by step.

Introduction: what multimedia is

Imagine you are using an educational app on your phone to study. It shows animated science experiments, explains each one in a teacher’s voice, gives you practice quizzes, and has video lessons by teachers from all over Nepal. Text, pictures, sound, video and animation are all put together in one place. That app is multimedia, and the tools and methods used to make it are multimedia technology.

The word is made of two parts: multi, meaning many, and media, the different forms in which information can be given (the plural of medium). So:

  • Multimedia is information presented using more than one kind of media together: text, graphics, audio, video and animation.
  • Multimedia technology is the hardware and software used to create, edit, store and play multimedia: cameras and microphones, editing programs, file formats, and the screens and speakers that show the result. Films, games and websites are all made with it.

You use multimedia apps every day:

  • Duolingo teaches languages with words, a voice to copy, sound effects and little animations that celebrate a right answer.
  • TikTok mixes short videos with filters, text on the screen and music.
  • YouTube combines videos, sound, thumbnails (the small picture you see before pressing play) and live chat, for learning as well as fun.
  • Google Earth joins satellite photos, text labels and 3D maps that you can fly through.

In Nepal, OLE Nepal’s E-Paath puts school lessons for the lower grades into interactive activities, with pictures, sound and animation, that students in government schools use on laptops and phones.

The five components of multimedia

The Water CycleHow water moves roundRain each monthTextthe title and wordsVideofilmed with a cameraAnimationmade, not filmedGraphicsa still chartAudiothe teacher’s voice
Figure 3.1 One screen of a learning app uses all five components: text for the lesson’s title and words, graphics for the chart of rain each month, audio for the teacher’s voice, video of a real experiment, and animation of the water moving round its cycle.

Every piece of multimedia is made from five kinds of media, its components:

  • a.Text: letters, numbers and symbols, such as headings, labels and captions.
  • b.Graphics: still pictures, such as photos, drawings, charts, logos and icons.
  • c.Audio: sound, such as speech, music and sound effects.
  • d.Video: moving pictures filmed with a camera, usually with their sound.
  • e.Animation: pictures that are made (drawn or modeled), not filmed, and shown one after another so that they seem to move.

What does the word “multimedia” mean?

Pick an answer to see why.

A cartoon character waves at you on a website. Which component of multimedia is it?

Pick an answer to see why.

Applications of multimedia

Multimedia is used wherever people want to explain, entertain, sell or keep in touch. Its main uses (its applications):

  • a.Education. E-books, online courses, learning apps and simulations (programs that copy how something real behaves, such as a circuit or a planet’s orbit) use multimedia, because seeing, hearing and trying things helps learners understand and remember. The interactive parts of this book are multimedia too.
  • b.Entertainment. Films, music, video games and virtual reality (a computer-made world you seem to stand inside, seen through a headset) are all multimedia. It has changed entertainment from something we only watch into something we can take part in.
  • c.Business. Advertisements on TV, on billboards and on phones use pictures, music and video to catch people’s attention, so that they remember the product. That makes marketing more effective. Businesses also use multimedia for presentations, training and showing products online.
  • d.Communication. Video calls, voice messages and social media use multimedia, so that we can see and hear family, friends and colleagues, even when they are working abroad.
  • e.Content creation. People who make videos, posters, podcasts and posts for social media depend on multimedia tools. Videos, graphics, animations and sound effects help them get their message across clearly and creatively, so more people see it.

Multimedia is used in many other places too: doctors study 3D scans, engineers test designs as animations, and news websites mix articles, photos, maps and videos.

Advantages and drawbacks of multimedia

Multimedia isn’t always the best choice. It has strengths and costs:

Advantages Drawbacks
It catches and holds attention better than text alone. The hardware and software to make it (cameras, microphones, editing programs, powerful computers) can be costly, and not everyone can get them.
It makes ideas easier to understand and remember: a diagram or a video shows what words struggle to say. Its files are large: they need a lot of storage, and fast, cheap internet to send and watch them, which many places don’t have.
It reaches people who can’t read well, or who learn better by seeing and hearing. It takes time and skill to make well.
It can be interactive: the user chooses, tries and gets feedback. Too many sounds, colors and movements can distract people from the message.
One file can be shared with thousands of people at almost no cost. It is easy to copy other people’s work without permission, breaking copyright.

Which of these is a drawback of multimedia?

Pick an answer to see why.

3.1 Text

Text is the letters, numbers and symbols you read on a screen. Because it is made of letters (alphabets) and numbers, it is also called alphanumeric data. Put together, these characters give meaningful information to the reader: a heading, a label on a diagram, the captions under a video.

You type and edit text in a text editor or a word processor. Common ones are Notepad (plain text only), WordPad (which can add simple styles) and Microsoft Word (a full word processor).

A computer keeps each character as a number, its code. In Unicode, the code shared by every modern computer and phone, “A” is 65 and “क” is 2325 (Grade 7, Text is numbers). So text takes very little space: a whole page of a book is only a few thousand bytes, less than one small photo.

Text is a part of multimedia because it can be presented in many ways: in different fonts (designs of letters), sizes, styles (bold, italic, underlined) and colors, moving onto the screen, or placed on a photo or a video. In multimedia, text usually does the jobs that need to be exact: names, numbers, headings, instructions and captions.

3.1.1 Text file formats

A file format is the way a file’s contents are arranged in bytes, so that a program knows how to read it. Its file extension, the letters after the dot in its name (notes.txt), tells you which format it is. Three common formats for text:

  • a.TXT (plain text) stores only the characters themselves: no fonts, sizes or colors. It is the simplest text format, and every computer and phone can open it.
  • b.RTF (Rich Text Format) stores text together with its style: font, size, color, bold and italic, line spacing, indentation and so on. It was made by Microsoft in 1987 so that documents could move between different word processors, and almost all of them can still open it.
  • c.DOCX is the native format of Microsoft Word (since Word 2007). Like RTF, it stores text with its styles, and also pictures, tables, page layouts, comments and much more.

Here is the same short note saved three ways. A TXT file holds only the characters:

notice.txt

Science Fair on Friday.

An RTF file is also text, but with control words, starting with a backslash, that describe the style. Open one in Notepad and you see them:

notice.rtf

{\rtf1\ansi{\fonttbl{\f0\fswiss Arial;}}\f0\fs28 Science Fair on {\b Friday}.\par}

\fs28 sets the font size in half-points (28 half-points is 14 points), and {\b Friday} makes that one word bold. A word processor reads these and shows the note in Arial, with “Friday” in bold. A DOCX file isn’t readable in Notepad at all: it is a ZIP file, a compressed folder, holding several files written in XML, a text language of tags.

TXT RTF DOCX
What it stores characters only characters and their styles characters, styles, pictures, tables, layout
Readable in Notepad? yes yes, with control words no (it is a ZIP)
File size smallest larger larger, but compressed
Opened by everything almost every word processor Word and most modern word processors
Good for notes, code, data sharing styled text between programs documents and reports

Which file format stores only text, with no styles at all?

Pick an answer to see why.

Which term describes the characters we see on a screen, also called alphanumeric data?

Pick an answer to see why.

3.2 Graphics

Graphics are the visual elements we see on a screen: photos, drawings, shapes, charts, icons and logos. Shapes in different colors, put together, give us information by sight. A map, a road sign or a pie chart tells you something in a second that would take a paragraph to write.

You make and change graphics in a graphics editor. Common ones are Pixlr (free, in a web browser), Adobe Photoshop (for photos) and Adobe Illustrator (for drawings and logos). With them you can draw and edit shapes, add effects and change photos as you like.

3.2.1 Raster and vector graphics

A computer can keep a picture in two quite different ways: as a grid of colored dots, or as a list of shapes. These are the two types of computer graphics, raster and vector.

Raster graphics

Raster graphics, also called bitmap graphics, are made of pixels. A pixel (short for picture element) is the smallest part of a picture that a screen can show: one tiny square of a single color. A raster picture is a grid of pixels, and the file stores the color of every one of them, row by row.

Look closely at your phone’s screen with a magnifying glass, or a drop of water on it: you will see the tiny dots. A photo of 4,000 × 3,000 pixels has 12 million of them, each with its own color. Together they make a detailed picture. So the more pixels a picture has, the more detail it can show. The number of pixels across and down is the picture’s resolution, such as 1,920 × 1,080.

Raster graphics are best for photos and paintings, where every pixel can be a slightly different color. Their weakness shows when you enlarge them: the computer has no more detail to show, so it just makes each pixel bigger, and the picture turns blocky (pixelated) or blurred.

The most common raster file formats are:

  • PNG (Portable Network Graphics) keeps every pixel exactly (it is lossless) and supports transparency: parts of the picture can be see-through, so a logo can sit on any background without a white box round it. Best for logos as pixels, screenshots, diagrams and anything with text.
  • GIF (Graphics Interchange Format) is an old format, from 1987, that can hold only 256 different colors. It can store several pictures in one file and play them one after another, so it is used for short, looping animations on websites and in messages.
  • JPG or JPEG (both the same format; Joint Photographic Experts Group, the committee that made it) is the most common format for photos. It compresses photos very well: it throws away fine detail the eye hardly notices (it is lossy), so photos of high quality fit in small files.

Vector graphics

Vector graphics are made of shapes: lines, curves, circles and polygons, each described by numbers, its mathematical formula. Instead of “this pixel is red, the next is red…”, a vector file says “a red circle, center here, radius this, outlined in black”.

start pointend pointcontrol point 1control point 2handlethe Bézier curve
Figure 3.2 A Bézier curve from a start point to an end point. Its shape is set by two control points (the squares), shown on handles. The curve leaves the start heading towards the first control point and arrives at the end coming from the second; in between, it is pulled towards both but touches neither. Four points describe the whole smooth curve.

The curves in vector graphics are usually Bézier curves. A Bézier curve is described by a few points: where it starts, where it ends, and one or two control points that pull the curve towards them, like a magnet bending a wire. Drawing programs show the control points as handles: drag one, and the curve bends smoothly.

Because a vector picture is a description, the computer draws it again from that description at whatever size it is shown. A logo stays perfectly sharp on a tiny ID card and on a banner across the school gate. And because a few numbers describe a whole shape, the files of simple drawings are small. Vector graphics are best for logos, icons, fonts, diagrams and maps, which are made of shapes with flat colors. They can’t store a photo, which has no shapes to describe, only millions of pixels.

The most common vector format is SVG (Scalable Vector Graphics), which most browsers, phones and graphics programs open. An SVG file is text you can read:

badge.svg

<svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 100 100">  <circle cx="50" cy="50" r="40" fill="gold" stroke="black"/>  <path d="M20 70 C35 20, 65 20, 80 70" stroke="green" fill="none"/></svg>

It says: a gold circle, outlined in black, with its center at (50, 50) and a radius of 40; then a green path from (20, 70) to (80, 70), bent by the control points (35, 20) and (65, 20). The C means a cubic Bézier curve. Every drawing in this book, the one above included, is SVG.

Try it

The same logo, raster and vector

The same small logo is kept as a raster picture (a grid of pixels) and as a vector picture (three shapes). Slide Zoom to the right and compare their edges.

Raster: 128 × 128 pixels
Vector: 3 shapes
Raster file: pixels × 3 bytes
16,384 × 3 = 49,152 bytes
Vector file: the shapes as text
about 170 bytes
The vector file says: background: light blue circle: center 68, 30; radius 15; yellowtriangle: corners 2, 92 / 38, 38 / 74, 92; greentriangle: corners 36, 92 / 70, 50 / 98, 92; dark green

At normal size the two look the same. Slide Zoom to the right.

Zoomed in, the raster shows its square pixels. The vector is drawn again from its shapes at the new size, so its edges stay sharp.

Raster graphics Vector graphics
Made of pixels, a grid of colored squares shapes (lines, curves, circles) described by mathematical formulas
Enlarged becomes blocky or blurred stays sharp at any size
Best for photos and paintings, with fine changes of color logos, icons, fonts, diagrams, maps
File size depends on the number of pixels the number of shapes
Edited with Photoshop, GIMP, Pixlr Illustrator, Inkscape, CorelDRAW
Common formats PNG, GIF, JPG SVG (also PDF, AI, EPS)

What type of graphics is made of Bézier curves and keeps its quality at any size?

Pick an answer to see why.

A photo of 800 × 600 pixels is enlarged to fill a big classroom screen. What happens?

Pick an answer to see why.

3.2.2 PDF: pages of text and graphics

PDF (Portable Document Format) stores whole pages: text, raster pictures and vector drawings together, with the fonts it uses packed inside. So it can hold raster graphics, vector graphics or both, depending on what was put into it and which program saved it. A scanned page is a raster picture inside a PDF; a page made in a word processor keeps its text and drawings as vectors, sharp at any zoom.

A PDF looks exactly the same on every computer, phone and printer, which is why it is the format for sharing documents online: forms, results, certificates, books and notices. It can also be used to store and share images and graphics. PDF was created by the company Adobe in 1993, and since 2008 it has been an open international standard (ISO 32000), so anyone may make programs that read and write it.

Which file format is commonly used for sharing documents online and can contain both raster and vector graphics?

Pick an answer to see why.

Try it

Which format?

For each thing, choose the format you would save it in. Some have two good answers. (MP3 and MP4, for sound and video, are coming later in this unit.)

A photo of your family at Dashain, to send to your uncle in Qatar

Which format would you save it in?

Tap a group above.

Card
1 of 12
Right the first time
0

3.2.3 Graphics editing

To start editing graphics, you can use Pixlr, a free graphics editor that works in a web browser. Its simpler editor is called Pixlr Express (earlier Pixlr X), and there is a phone app too. You can crop, resize, rotate, adjust colors, add filters, and much more. The steps below follow Pixlr, but every graphics editor (Photoshop, GIMP, Canva, the editor in your phone’s gallery) works in much the same way, with the same ideas and similar names.

Before you start, learn the four main areas of the screen:

  • Canvas area: the workspace in the middle, where you see and edit your picture.
  • Tools panel: the strip of tools on the left side (text, shapes, cutout, crop, filters…).
  • Layers panel: on the right, where you manage the picture’s layers (its photos, shapes and text).
  • Navigation tools: at the bottom, to zoom in and out, move around (pan) and rotate the view.
TSCIENCE FAIRTitleBadgePictureBackground−+ 100%CanvasToolspanelLayerspanelNavigationtools TSCIENCE FAIRTitleBadgePictureBackground−+ 100%Tools panelCanvasLayers panelNavigation tools
Figure 3.3 The four main areas of a graphics editor such as Pixlr: the canvas in the middle, the tools on the left, the layers on the right and the navigation tools at the bottom.

Creating a new project

A project is the picture you are working on, with all its layers. To start one:

  1. Go to the Pixlr website (pixlr.com) and choose Pixlr Express.
  2. A page opens where you can open an existing image or create a new one.
  3. To start with a blank canvas, choose Create new. A dialog box appears.
  4. Choose a canvas size from the presets (ready-made sizes, such as a poster or a social media post), or type your own width and height in pixels. For example, name the project “Class 10 Project” and make it 1920 × 1080 pixels, the shape of a wide screen.
  5. Click the Create button at the bottom right.
  6. Your project is made, and you can start creating and editing.

Working with text

  1. In your new project, find the Text tool on the left of the screen. Its icon is a capital “T”.
  2. Click Add new text. A text box with sample words appears on the canvas.
  3. Type your own words in the box, or paste text copied from somewhere else.
  4. With the text selected, use the options on the left to change its font, size, style, color, alignment and spacing.
  5. To make the text bigger or smaller, drag the handles (the small squares on the box’s corners and edges). To move it, drag the text, or press the arrow keys while it is selected.
  6. To rotate the text, drag the round handle above the box.
  7. To change the text later, click its layer in the Layers panel on the right. From there you can also hide, lock, duplicate or delete it.

Working with shapes

  1. Click the Arrange tool (or Element) on the left sidebar. It offers three options: choose Shape.
  2. A shape appears on the canvas: a square at first.
  3. In the Type section, choose the shape you want instead, such as a circle.
  4. Use the options on the left to change its fill color (the inside), its outline color and its shadow.
  5. Drag the small square handles at its corners to change its size, and the round handle at the top to rotate it.

Working with layers

A layer is like a clear plastic sheet with something on it: one sheet for the background, one for a photo, one for a shape, one for the title. Stacked up, they make the picture you see. A layer higher in the stack covers the ones below it, except where it is empty (transparent), where you see through to the next.

Layers let you change one part without spoiling the rest. Move the title, and the photo under it is untouched: nothing was painted over it. Hide the background, and everything else stays. That is why editors put each new text, shape or photo on a layer of its own.

Try it

A poster in four layers

The poster on the right is four layers, pulled apart on the left. Tap a layer in the list, then hide it or move it up or down. What happens when the background is not at the bottom?

FRISCIENCEFAIRFRISCIENCEFAIRthe layers, pulled apartwhat you see
Layers (top first):

From the bottom: the background, the picture, the badge and the title on top. Each part is on its own sheet.

To use layers in Pixlr:

  1. Find the Layers panel on the right of the screen.
  2. Click the + button to add a new layer.
  3. The Add layer dialog box opens. Choose what kind of layer to add: for example, a shape layer, an image layer or an empty layer.
  4. Click the three-dot button (⋯) on a layer to open its options.
  5. There you can give the layer a name, lock it (so it can’t be changed by mistake) or hide it.
  6. You can also change a layer’s opacity (how solid it is: 100% hides what is below, 50% lets half of it show through) and its blend mode (how its colors mix with the layers below; Multiply, for example, darkens them, as two inks printed on top of each other do).
  7. To change the order of the layers, drag a layer up or down in the Layers panel.

A poster’s title can’t be seen, even though its layer is switched on. What is the most likely reason?

Pick an answer to see why.

Inserting an image in a project

You can put a photo into a project you have already started:

  1. Click the Element icon (in the tools panel).
  2. Click Add media (or Add image) in the options that appear.
  3. Find the picture on your computer and click Open.
  4. The picture is placed in your project, on a new layer of its own, where you can move, resize and rotate it like a shape.

Using the cutout tool

The cutout tool cuts an object out of its background: a person out of a crowd, a mango off a plate, so it can go on a new background or poster.

  1. Open a picture in Pixlr and click the Cutout icon on the left side of the screen.
  2. Choose the Cutout option from the list.
  3. Choose the shape of the cutout, and the softness of its edges (soft edges blend in better than hard ones).
  4. Click and drag over the object you want to cut out. The tool guesses the object’s edges.
  5. Use Keep and Remove to fix the selection: Keep adds the area you brush over, Remove takes it away.
  6. The Draw cutout tool lets you add or remove parts by painting freely over them.
  7. The Lasso cutout tool lets you draw round the part you want, freehand, like a lasso round a cow.

Many editors can now cut out the main object by themselves, using AI. Check the edges anyway: hair, fingers and see-through things often come out wrong.

Exporting the project

When your picture is finished, export it: save it as an ordinary image file that anyone can open, share or print.

  1. Click the Save button at the bottom right.
  2. A window opens, where you choose the file name, the format and the quality.
  3. Choose the format that suits the job. Pixlr can save JPG (photos, for the web and print), PNG (keeps transparency and sharp edges), WEBP (a newer format for web pages, with smaller files) and PXZ (Pixlr’s own format, which keeps every layer, so you can open the project again and go on editing it).
  4. Set the quality slider. Higher quality keeps more detail but makes a bigger file; lower quality makes a smaller file but loses detail, and blocks and smudges appear.
  5. Click Save as to save the picture to your device.
  6. A window opens where you choose the folder, and the file is saved.

Try it

Quality against file size

This is what the quality slider does. Your browser saves this photo of Boudhanath as a real file each time you change something, and shows its real size. Make it fit under 200 KB, and watch the close-up: which costs more, fewer pixels or lower quality?

Loading the photo…

Close-up of the red box: the saved file’s own pixels, 2.6 times bigger
Format:
Width:
Size in pixels
1,600 × 1,067
Raw (× 3 bytes a pixel)
4.9 MB
The saved file
…

The browser is saving the photo as a file…

PNG keeps every pixel exactly, so a photo’s file is huge. PNG is for screenshots and drawings; for a photo, choose JPEG or WebP.

It fits, and the close-up still looks clean. This is the way: fewer pixels first, then the quality only as low as it must go.

It fits, but look at the close-up: at this quality, blocks and smudges appear round the sharp edges. Try a smaller width and a higher quality.

Too big for the form. Make it narrower first: half the width is a quarter of the pixels. Then lower the quality a little.

Photo: Jorge Láscar, CC BY 2.0, via Wikimedia Commons

3.3 Audio

Audio is sound in multimedia: speech, music, the sound of instruments, and sound effects. Every sound is made by something vibrating: a guitar string, the skin of a madal, your vocal cords. The vibration pushes the air back and forth, and those pushes travel to your ear. A microphone turns them into an electrical signal that rises and falls in the same way, and a computer stores that signal as a digital file of numbers.

3.3.1 Audio waveform

Sound changes from moment to moment. To show how it changes, we draw a graph of it against time, called an audio waveform: time runs from left to right, and the height of the line shows how far the air (or the microphone) is pushed at each moment.

A waveform has two things to read:

  • Amplitude is the height of the wave, from the middle line to a peak. It shows how loud the sound is: the bigger the vibration, the taller the wave, and the louder the sound.
  • The width of one complete wave shows how quickly the sound vibrates. The time one wave takes is its period, and the number of waves in one second is its frequency, measured in hertz (Hz). Frequency decides the pitch: narrow, close-together waves are a high sound (a whistle), wide ones a low sound (a drum).
0481216time (milliseconds)pushnonepullamplitude(loudness)one wave: 4 ms, the period250 waves a second = 250 Hz
Figure 3.4 A waveform drawn against time. Amplitude is the height from the middle line to a peak: the loudness. One complete wave, from one peak to the next, takes 4 milliseconds here: its period. So this sound makes 250 waves a second: its frequency is 250 Hz, a low note, a little below the middle of a piano.
loudquietlow pitchhigh pitchsame pitch, taller wavessame pitch, smaller wavessame loudness, wide wavessame loudness, narrow wavesa spoken word, zoomed outloud syllables are tall;the gaps between them are flat silence
Figure 3.5 The same note loud and quiet (only the amplitude changes), and a low and a high note (only the width of the waves changes). Below, a recorded word as a sound editor shows it, zoomed out: the separate waves are too narrow to see, so you see the outline of their heights, loud syllables tall and the silence between words flat.

To store a sound, the computer measures the waveform’s height again and again, at equal intervals of time. Each measurement is called a sample, and it is kept as a number. The list of samples is the digital representation of the waveform, and it is saved as a sound file. Two settings decide how good the copy is:

  • the sample rate: how many samples are taken each second. A music CD takes 44,100 a second; phone calls about 8,000.
  • the bits per sample: how many levels each measurement can be rounded to. With 3 bits there are only 8 levels, from 000 to 111; a CD uses 16 bits, 65,536 levels.

Try it

Sampling a sound

The gray line is the sound; the dots are the samples, each rounded to one of the levels. With 3 bits, there are 8 levels, 000 to 111. Change the sample rate and the bits, and watch how closely the steps follow the wave. Press Listen to hear the difference.

04 thousandths of a second
Samples a second:
Bits a sample:
Levels
8
Bytes for 1 second
3,000
For 1 minute
176 KB

Only a few samples: the dots miss the wave’s wiggles, so the stored sound is rough.

Few bits, few levels: each sample is rounded to the nearest level, so the steps jump.

More samples and more levels: the steps follow the wave more closely, but each second takes more bytes.

44,100 samples a second, 16 bits each, as on a music CD: the steps are too small to see or hear.

What does the amplitude of an audio waveform represent?

Pick an answer to see why.

On a waveform, a singer’s note suddenly shows waves twice as close together, of the same height. What changed?

Pick an answer to see why.

3.3.2 Audio file formats

There are many audio formats, but three are the most common:

  • MP3 (MPEG-1 Audio Layer III, often written MPEG Audio Layer 3) is the most used format for sharing music and recordings, because it compresses sound very well. It throws away parts of the sound that the ear can’t pick out (such as a quiet sound right next to a loud one), so a song shrinks to about a tenth of its size with little difference you can hear. It is lossy.
  • AAC (Advanced Audio Coding) was made later, as an improvement on MP3. Its methods of compression are more advanced, so at the same file size it usually sounds better than MP3. It is used by YouTube, by iPhones and by many phones’ voice recorders (often in files ending .m4a). It is lossy too.
  • WAV (Waveform Audio File Format) usually stores the samples uncompressed, exactly as they were recorded. Nothing is lost, but its files are large. It is used while recording and editing, before the finished sound is saved as MP3 or AAC.
MP3 AAC WAV
Full form MPEG-1 Audio Layer III Advanced Audio Coding Waveform Audio File Format
Compression lossy lossy, more advanced usually none
A minute of music about 1 MB about 1 MB, sounds a little better about 10 MB
Used for sharing music and recordings, everywhere streaming, phones, YouTube recording and editing

Which audio format is known for its effective compression and is the most common for sharing audio files?

Pick an answer to see why.

You want to store a recording of your own voice on a computer, keeping it exactly as recorded, to edit later. Which format should you use?

Pick an answer to see why.

3.3.3 Audio editing

To start editing sound, you can use AudioMass, a free audio editor that works in a web browser, at audiomass.co. You can record, cut, add effects and save, with nothing to install.

Its screen has three main areas:

  • Menu bar: at the top, with menus such as File, Edit, View, Effects and Help.
  • Control panel: the buttons to play, pause, stop and record, the time, and the volume.
  • Waveform display: the sound’s waveform, where you select parts to cut, copy, paste, delete or trim.
FileEditViewEffectsHelp00:03.250selectedMenu barWaveformdisplayControlpanel FileEditViewEffectsHelp00:03.250selectedMenu barWaveform displayControl panel
Figure 3.6 The three main areas of an audio editor such as AudioMass: the menu bar, the control panel with its play and record buttons, and the waveform display, with part of the sound selected.

Recording audio

  1. Open audiomass.co in your web browser. The editing screen appears.
  2. Click the Record button (the red circle) in the control panel, or press the R key.
  3. A New recording dialog box appears. The first time, your browser asks whether the site may use your microphone: click Allow.
  4. In the Devices section, check that the right microphone is chosen.
  5. Click Start recording and speak (or play).
  6. To stop, click Finish recording.
  7. Click Open recording to open it as a waveform in the editor.

For a clean recording, hold the microphone about a hand’s width from your mouth, in a quiet room with soft things in it, and record a few seconds of silence first (Grade 8, Recording clean sound).

Importing audio

You can also open a sound file you already have:

  1. Click the File menu at the top left and choose Load from computer.
  2. A window opens. Find the folder where the sound file is, select it and click Open.
  3. AudioMass opens the file and shows it as a waveform.

Cutting the waveform

To remove a part you don’t want (a cough, a long pause, the start before anyone spoke):

  1. Select that part: click at its start and drag to its end. It is marked by a colored box.
  2. Click the scissors (Cut) button on the toolbar. The selected part is removed, and the sound on either side joins up.

The flat stretches of a waveform are silence, and the tall parts are loud: so you can often see where to cut before you even listen.

Applying effects

Effects change how a sound sounds:

  1. Select the part of the sound you want to change, by clicking and dragging on the waveform.
  2. Open the Effects menu. It lists effects such as Normalize (makes the loudest point as loud as allowed, so a quiet recording gets louder evenly), Fade in and Fade out (the sound grows from or dies away to silence), Reverse (plays it backwards), pitch shift (higher or lower), Reverb and more.
  3. Choose an effect and set its parameters (its settings) if it has any.
  4. For example, reverb adds the echoes of a room or a hall. Its settings include the time and decay (how long the echoes last and how fast they fade) and wet (how much of the echoed sound is mixed in with the original, the “dry” sound). Click Apply.
  5. Play the sound to hear the effect. If you don’t like it, use Edit → Undo.

Exporting audio

  1. Click the File menu at the top left.
  2. Choose Export / Download.
  3. A dialog box opens. Type a file name, choose the format (MP3 or WAV), the quality (the bitrate: more kilobits a second sounds better but makes a bigger file) and the channels (mono, one channel, or stereo, two).
  4. Click Export. The file is saved with your settings.

3.4 Video

Video is a series of still pictures, called frames, shown one after another so quickly that we see motion. A video usually has an audio track too, which plays in time with the frames. A camera makes a video by taking a photo (a frame) many times a second; a screen plays it by showing those frames in order, just as fast.

A strip of 16 mm cinema film seen close up: three still pictures, each saying The End, one above the other, with sprocket holes on the left and a wavy white line running down the right
Figure 3.7 A piece of 16 mm cinema film from 1959, close up. Each picture is one frame (these are the last ones, “The End”); a projector showed 24 of them every second. The wavy white band beside the frames is the sound, stored on the same strip as its waveform: the band’s width swings in and out with the sound wave, and the louder the sound, the wider it swings. Photo: U. S. Navy. Photographed by Cmacd123 at en.wikipedia, Public domain

3.4.1 Frame rate

The number of frames shown each second is the frame rate, measured in frames per second (fps). The frame rate decides whether a video looks smooth or choppy: the higher the frame rate, the smoother the motion; the lower, the jerkier.

Common frame rates:

  • 24 fps: cinema films, since the 1920s, which gives them their slightly dreamy “film look”;
  • 25 fps: television in Nepal, India, Europe and other countries that used the PAL TV system, whose electricity runs at 50 Hz;
  • 30 fps: television in the Americas and Japan (NTSC), and many phone videos;
  • 50 or 60 fps: sport, games and fast action, which need very smooth motion.

Below about 10 or 12 frames a second, most people stop seeing smooth motion and start seeing separate pictures. A higher frame rate costs more: twice the frames means about twice the data to store and send.

Try it

Frames a second

The same ball crossing the screen, shown at different frame rates. Below it, every frame of one crossing (a second and a half) is drawn at once. Compare 6 and 60.

what the screen showsevery frame of one crossing(19 frames in 1.5 s)
Frame rate:
Frames each second
12
Time between frames
83 ms
Frames in a minute
720

At 12 frames a second the movement starts to join up, but it still looks jerky, like an old cartoon.

A game looks jerky. A friend says the game is running at 8 frames per second. What would make it smoother?

Pick an answer to see why.

3.4.2 Resolution

Pixels are the tiny squares that make up a digital picture (3.2.1). A video frame is a picture too, so it is made of pixels. Resolution is the number of pixels in a frame (or any picture), written as width × height in pixels, such as 720 × 480 or 1920 × 1080. The more pixels, the more detail can be shown: a higher resolution gives a clearer picture, but also a bigger file.

Some resolutions are standards, used by TVs, cameras, phones and video sites:

  • SD (standard definition): 720 × 480 pixels. A low resolution, used by old TVs and DVDs. It shows the main shapes, but not much detail. (In countries with PAL television, Nepal and India among them, SD was 720 × 576.)
  • HD (high definition): 1280 × 720 pixels (also called 720p). Used by newer TVs and online videos; it shows more detail than SD, but less than FHD.
  • FHD (full high definition): 1920 × 1080 pixels (1080p). Used by most TVs, monitors, laptops and phone cameras; it shows a lot of detail, and it is the most common resolution for videos and games.
  • 4K UHD (ultra high definition): 3840 × 2160 pixels, four times as many as FHD, for big TVs and cinema.

Try it

SD, HD, FHD and 4K

The four frames drawn to the same scale, one pixel of the frame as one tiny dot. The close-up shows the same small part of the picture, a kite and its string, as each resolution would record it.

4KFHDHDSDthe frames to scale1,920 × 1,080 pixelsclose-up of a kite24 × 24 pixels of it
Resolution:
Pixels in a frame
2,073,600
One frame, raw
5.9 MB
A minute raw, 30 fps
10.4 GB
A minute as MP4, about
57.2 MB

FHD (1080p) has six times the pixels of SD: the string shows as a fine line. This is the usual resolution for phones and TVs.

What does the resolution of a video mean?

Pick an answer to see why.

3.4.3 Video file formats

The three most common video formats are MP4, MOV and AVI:

  • a.MP4 (MPEG-4 Part 14) is the most used video format, because it compresses video very well and plays on almost everything: phones, computers, TVs and video sites.
  • b.MOV is the format of Apple’s QuickTime movie player. It can hold video that is compressed or uncompressed, as needed, and is used by iPhones and by video editors.
  • c.AVI (Audio Video Interleave) is an older format from Microsoft (1992). It can also hold compressed or uncompressed video, but its files are usually bigger than MP4’s.

A video file holds two things, the frames and the sound, so a video format is really a container: a box with a video track and an audio track inside, kept in step. Inside an MP4, the frames are usually compressed by a method called H.264 and the sound by AAC. You may also meet MKV (Matroska), a free container that can hold many sound tracks and subtitles at once, often used for films.

Which video format is most commonly used because it compresses video well?

Pick an answer to see why.

3.4.4 Video editing

To start editing videos, you can use CapCut, a free video editor that works in a web browser and as a phone app (CapCut – Video Editor). You can cut and arrange clips, add transitions, effects and text, and more.

Its screen has four main areas:

  • Timeline area: along the bottom, where you arrange and edit your clips, sound, effects and text in time order.
  • Tools panel: on the left, with the media, audio, text, transitions, effects and other tools.
  • Preview area: in the middle, where you watch the video as it will look.
  • Export and share options: at the top right, to save the finished video in a chosen format and share it.
MediaAudioTextTransitionsEffects00:12 / 00:40Exportclip 1clip 2clip 3T Title♪ musicToolspanelPreviewExport andshareTimelineplayhead MediaAudioTextTransitionsEffects00:12 / 00:40Exportclip 1clip 2clip 3T Title♪ musicTools panelPreviewExport and shareplayheadTimeline
Figure 3.8 The four main areas of a video editor such as CapCut: the tools panel on the left, the preview in the middle, the export button at the top right, and the timeline along the bottom, with the playhead marking the moment shown in the preview.

Creating a new project

  1. Go to CapCut’s website (capcut.com) and sign in.
  2. On the home page, click Create new video.
  3. The Select aspect ratio box opens. The aspect ratio is the shape of the video, written as width : height. Choose 16 : 9 for a wide video (TV, laptop, video sites) or 9 : 16 for a tall one (a phone held upright).
  4. A new project is made, and the editing screen opens.
  5. At the top left you see “Untitled project”. Click it and type a name for your project.
  6. The project is renamed.

Importing videos

  1. Click Media on the left of the screen.
  2. Click Upload. The upload options open.
  3. Click From this device. A file window opens.
  4. Choose the videos, photos or sound files you want, and click Open.
  5. They are added to the project’s media, ready to use.

Working in the timeline

The timeline shows your video as time from left to right, with the clips in a row on the video track and other tracks for text and sound. The playhead (or timeline cursor), a vertical line, marks the moment shown in the preview.

  1. Click a clip in the media panel to add it to the timeline, or
  2. drag it from the media panel onto the timeline, to the place you want it.
  3. The clips play in the order you place them, from left to right.
  4. To change the order, press and hold a clip and drag it to a new place.
  5. Use the zoom slider to zoom in on the timeline (to work on a few seconds exactly) or out (to see the whole video).
  6. To play the video, click Play in the preview area, or press the Spacebar.
  7. The playhead moves along the timeline, and the preview shows the video.
  8. Press the same button (or Spacebar) again to pause, and again to go on.
  9. Drag the playhead to any point to jump there.
  10. The playhead’s time is shown below the preview window, at the bottom left.
Trim: drag a clip’s endto cut off a dull partSplit: cut a clip in two,then move or delete a part0:000:100:200:300:400:501:00VideoCaptionsMusic123a3b45Captions: the words on screen,each shown between two timesMusic: fades in and out, and isturned down while people speakPlayheadA one-minute video: 5 clips, 58 seconds in all 0:000:200:401:00PlayheadVideoCaptionsMusic123a3b45Trim: drag a clip’s end to cut offa dull part.Split: cut a clip in two, then moveor delete a part.The words on screen, each shownbetween two times.Fades in and out, and is turneddown while people speak.A one-minute video: 5 clips,58 seconds in all
Figure 3.9 A video editor’s timeline. Clip 2’s end is being trimmed; clip 3 has been split into two parts. The captions sit on their own track, and the music fades in and out and is turned down while people speak. The playhead marks the moment shown in the preview.

Trimming and cutting videos

  • To trim a clip, drag the handle at its start or its end. This cuts off the part you don’t want at that end, and changes how long the clip lasts.
  • To split (cut) a clip in two, move the playhead to the moment where you want the cut, and click Split.
  • To delete an unwanted part, split it off, select it, and press Delete. The clips after it move up to close the gap.

Adding transitions

A transition is how one clip changes into the next: a fade, a dissolve (one picture melting into the other), a wipe, a slide.

  1. Point at the join between two clips, and click Add transition (it appears when you hover there), or open Transitions in the tools panel.
  2. The list of transitions appears on the left.
  3. Browse through them, or search for one by name.
  4. Click a transition to put it on the join.
  5. Change how long it lasts by dragging the edges of its slider.
  6. Repeat for the other joins that need one.

Most good videos use few transitions: a plain cut from one clip to the next is what films use most. Save fades for a change of place or time.

Adding effects

Effects change how a clip looks: a filter of colors, a blur, a glow, shaking, slow motion.

  1. Click Effects on the left panel. The effects menu opens.
  2. It shows the effects in groups.
  3. Browse to find the one you want.
  4. Move the playhead to where the effect should start.
  5. Click the effect. It is added to the timeline from that point.
  6. Double-click the effect on the timeline to open its settings,
  7. and change its properties (its strength, speed and so on).
  8. Repeat for any other clips.

Adding text

  1. Click the Text icon on the left.
  2. Choose plain text (such as Add heading) or a ready-made text template.
  3. Click Add heading: a text box appears on the preview.
  4. Double-click the box and type your words.
  5. Change the font, size, color and position in the Properties panel that opens.
  6. The text has its own clip on the timeline. Drag its edges to set when it appears and disappears.

Exporting the project

  1. Make sure the project you want to export is open.
  2. Click Export at the top right of the screen.
  3. Click Download.
  4. Choose the quality, resolution (720p, 1080p…) and frame rate, and the format (MP4), then click Export.
  5. When the video is ready, click Download to save it on your computer.

3.5 Concept of animation

Animation is pictures or graphics that move. Unlike video, nothing is filmed: each picture is made, drawn by an artist or generated (worked out) by a computer, and the pictures are shown one after another, just like the frames of a video. In multimedia, animation usually means movement made on a computer. It is used for cartoons, advertisements, films, video games, websites and lessons (the moving water in Figure 3.1 is one).

Each small change from one picture to the next looks, to your brain, like one thing moving. That is all an animation is: still pictures, slightly different, shown fast.

Twelve small photos of a racehorse and rider in a grid: eleven taken a moment apart as it gallops, its legs in different positions, and the last of the horse standing
Figure 3.10 The Horse in Motion, by Eadweard Muybridge, 1878. He set up a row of cameras along a racetrack in California, each triggered as the horse passed, to settle a question: does a galloping horse ever have all four hooves off the ground? It does (in the second and third photos of the top row), with its legs tucked under it. Shown one after another, these photos make one of the first moving pictures. Photo: Eadweard Muybridge, Public domain

Psychology, the study of how people think and feel, plays a big part in animation. Animators use what they know about attention and feelings to make their work interesting and easy to follow:

  • Bright colors and movement catch the eye quickly. That is why cartoons for children are bright and lively, and why children are drawn to them.
  • Faces that show feelings, funny or sad, help viewers connect with the characters and care about the story.
  • Smooth, well-timed movement makes an animation enjoyable to watch. A ball that speeds up as it falls and slows down as it rises looks real; one that moves at a steady speed looks stiff and fake.

By understanding what attracts people’s attention, animators make animations that are more fun, more exciting and easier to understand.

Animation is mainly of two types: 2D animation and 3D animation.

3.5.1 2D animation

2D animation is flat: it is made in two dimensions, width and height only, like drawings on paper. It is usually made frame by frame in an animation program: the artist draws each picture, or draws the most important ones and lets the program help with the rest.

Drawing every frame is slow (a minute at 24 fps is 1,440 pictures), so animators work in two steps:

  1. Keyframes: the animator draws the most important positions, where a movement starts, ends or changes direction. For a bouncing ball, its highest points and the moments it hits the ground.
  2. In-betweens: the pictures in between the keyframes are filled in, by assistants in the old days, and today usually by the computer, which works out the steps from one keyframe to the next. This is called tweening.

The spacing of the in-betweens decides how the movement feels: frames close together are a slow part, frames far apart a fast part.

Try it

A ball bouncing, frame by frame

The diamonds on the strip are the keyframes; the dots between them are in-betweens. Drag the slider to flip through the frames, or press Play. Turn on Onion skin to see the frames before and after, faintly, as animators do. Then try fewer in-betweens.

In-betweens:
Frames
21
Keyframes
6
In-betweens
15

A keyframe: the top of a bounce, drawn by the animator. Here the ball stops rising and starts to fall.

In 2D animation, what are keyframes?

Pick an answer to see why.

3.5.2 3D animation

3D animation is made in three dimensions: width, height and depth. Instead of drawings, the animator builds a 3D model inside the computer, which can be seen from any side, with light and shadow and perspective (near things look bigger than far ones), as in the real world. It is made in steps:

  1. Modeling: the character or object is built as a 3D shape, a mesh of thousands of tiny flat faces, and given its colors and surface (skin, cloth, metal).
  2. Rigging: a skeleton of bones and joints is put inside the model, so that moving a bone moves the part of the model round it, as your arm moves when you bend your elbow.
  3. Animating: the animator sets keyframes by posing the skeleton, and the computer works out the in-betweens.
  4. Rendering: the computer draws every frame as a picture, working out how the light falls on every surface. For a film, this can take hours a frame, on many computers at once.
2D animation 3D animation
Dimensions width and height width, height and depth
Looks flat, like a drawing solid, with perspective, light and shadow
Made by drawing frames (keyframes and in-betweens) modeling, rigging, animating and rendering
Seen from one side only, as drawn any angle: the camera can move round it
Examples classic cartoons, GIF stickers, explainer videos animated films, video games, product adverts
Programs Adobe Animate, Krita, OpenToonz, Pencil2D Blender, Maya, 3ds Max

In 3D animation, what are the three dimensions?

Pick an answer to see why.

What is the main feature of 2D animation?

Pick an answer to see why.

Exercise

1. Write the full forms

1.

Write the full forms of these abbreviations:
i. RTF ii. PNG iii. GIF iv. JPG v. SVG vi. PDF vii. MP3 viii. AAC ix. MP4 x. AVI

Answer

2. Choose the correct answer

i. What does the term “multimedia” refer to?

Pick an answer to see why.

ii. Which is a drawback of multimedia?

Pick an answer to see why.

iii. Which of these is a standard text file format that stores only text?

Pick an answer to see why.

iv. Which term describes the characters we see on the screen, also known as alphanumeric values?

Pick an answer to see why.

v. What type of computer graphics is made up of Bézier curves and keeps its quality at any size?

Pick an answer to see why.

vi. Which file format is commonly used for sharing documents online and can contain both raster and vector graphics?

Pick an answer to see why.

vii. What does amplitude represent in an audio waveform?

Pick an answer to see why.

viii. Which audio file format is known for its effective compression and is commonly used for sharing audio files?

Pick an answer to see why.

ix. What does resolution in video refer to?

Pick an answer to see why.

x. Which video format is commonly used for storing videos with high compression?

Pick an answer to see why.

xi. In 3D animation, which three dimensions give the animation its perspective?

Pick an answer to see why.

xii. What is the main feature of 2D animations?

Pick an answer to see why.

3. Write short notes

a.

Write a short note on the components of multimedia.

Answer
b.

Write a short note on Rich Text Format.

Answer
c.

Write a short note on the audio waveform.

Answer
d.

Write a short note on video resolution and frame rate.

Answer
e.

Write a short note on raster and vector graphics.

Answer
f.

Write a short note on 2D and 3D animation.

Answer

4. Answer these questions

a.

What are the five main components of multimedia?

Answer
b.

Define raster graphics.

Answer
c.

Name three common raster image file formats.

Answer
d.

Explain the difference between raster and vector graphics.

Answer
e.

Why is multimedia important in education and business?

Answer
f.

How does a DOCX file differ from a TXT file?

Answer
g.

If you had to create a greeting card, which multimedia components would you use, and why?

Answer
h.

Suggest a suitable image format for a company’s logo with a transparent background, and give the reason.

Answer
i.

Which type of graphic, raster or vector, would you use to design a billboard? Justify your answer.

Answer
j.

Compare the use of multimedia on YouTube and Google Earth. What are the similarities and differences?

Answer
k.

Draw a simple interface for a multimedia learning app, and list which multimedia elements you would include, with reasons.

Answer
l.

Evaluate the impact of video content compared with other media (text or audio) in digital communication.

Answer

5. Activities

6. Project work

A companion to your textbook, not a replacement for it: study from the book your school uses, and where the two differ, follow your teacher. Found a mistake? Please tell us.