3Rd grade dra levels
What Reading Level Should a Third Grader Be At?Making English Fun
Reading Levels are most commonly used to find the instructional and independent reading levels of students. For 3rd grade reading levels this will enable teachers, parents and students to choose appropriate reading literature.
If the reading level of the book is in this ”goldilocks” zone then it will help students practice and develop reading skills that are just challenging enough. Too easy it becomes boring, and too difficult it becomes frustrating.
For third grade students this is a huge step forward. To do this, it is important to gauge at what reading level the student is performing and to do that you have to assess what their 3rd grade reading levels are.
Third grade reading levels commonly range from 12 to 25 on R.R. and PM Benchmarks. Higher levels in this range means that they are nearing the top of the class, but lower levels should not cause any issues at this stage. Guided reading and levelled books will help 3rd graders improve their reading skills.
Reading at appropriate levels is especially important in grade three English lessons. Students at this age and development stage are starting to read for fun and enjoyment, they are starting to choose their own interests.
Although there is still plenty to learn in English, they will be starting to master phonics and pronunciation rules at this stage and focus will be on reading comprehension and reading to learn. ( if a high enough level has been achieved)
This what reading level should a third grader be at article will also cover the following information:
- Targeted information on reading levels and how you as parents and teachers can help your students by having knowledge of them
- Tips and advice to help your 3rd grade students develop to the best of their abilities.
- Some of the grammar, Phonics and other English Topics that a 3rd grader will learn in reading lessons.
- Links to our Reading resources, for 3rd grade and others.
- Advice for both teacher and parents on 3rd grade reading levels
We have a selection of reading resources in the link below if you want to get stuck in. These range from grade 2 up to grade 4 and loads of phonics resources as well – and are printable with comprehension questions included
There are free versions of these on the site as well however the bundle is a better option!
Why Are Reading Levels Important
Reading levels in English are an excellent way for teachers, parents to provide differentiated instruction and resources that target a students strengths and areas for improvement. They provide a individual leveled starting point to challenge but not frustrate students English progress.
Reading levels allow teachers and parents to implement the following:
- Develop Reading schemes such as guided reading, reading groups, buddy reading etc
- Target individual students needs (differentiated learning)
- Target areas for further practice, and reading skills that need reinforcing
- Provide self learning and reading opportunities by having leveled reading resources in the home and classrooms.
- Develop a reading awareness for students. allowing them to choose their own materials, at their own reading levels.
- Increase confidence in students as they see their needs being met and being taught at instructional rather than frustration levels of English.
In third grade reading levels start to play an increasing level of importance. Students at this age will be starting to progress at different speeds, even more pronounced that in grade 2. This has the potential to create large differences in abilities and reading levels in classrooms.
Being able to address those differences in an effective, time saving and thought out manner is going to have a knock on effect on more than just grades. Classroom management should become easier as students are given reading materials and tasks appropriate to them and their needs and requirements.
Although the holistic benefits of both knowing and incorporating reading levels in to lessons are many. In todays educational environments grades and results are of course still vitally important.
Just to show some examples of this, rather than just tell you about it. I have a REAL leveling information sheet for a 3rd grade class below. This shows their reading level at the beginning of the year and their reading level at the end of the year.
You can click on the image to make it larger…. I have changed their names for privacy. (I did have some strange names in my classes but I never had anyone named strawberry 😉 … I did however have a shark boy!
You can see, even with just a cursory glance, the huge improvements this 3rd grade class made throughout the school year. Even if they were among lower level readers at the beginning they improved dramatically buy the end of the year.
The higher levels may have less dramatic ( but still impressive) improvement mainly as their general English lessons are not challenging enough, but also the higher the level of English the slower, relatively speaking, the progress.
What are the Different Leveled Reading Programmes
There are numerous different leveled reading programs that although using different grading systems, all follow a simple enough premise. Books, and reading material, in all systems are written with increasing difficulty, word count and phonics as each level progresses.
We have included an image below ( from REAL) of some of the levelled reading systems and how they compare to each other ( to help with book purchases if needed).
Many Guided reading publishers have developed their own systems as well.
- Scholastic Guided Level Reading Program
- CCSS Lexile Recommendations
- DRA Level
- PM Benchmark
Other Grade Reading Levels
We have a collection of articles on other grade reading levels below.
Other Grades Average Reading Levels.
We have a selection of articles on reading level expectations for different grades below.
What is the Difference between Instructional, Frustration and Independent Reading levels.We include this information in all our levelled reading articles.
What is an Instructional Reading Level?
Instructional Reading level is the reading level directly below independent. Students should be able to comprehend and decode upwards of 80% of the text at an instructional level. This level can vary between students and also between subjects as students have interest and motivators that differ.
What is an Independent Reading Level?
An independent reading level is a level of reading ability that allows students to read texts without assistance from teachers or parents. When reading this level of text students will be able to decode over 90% of words and answer increasingly complex comprehension questions independently.
What is a Frustration Reading Level?
Frustration level reading can be defined as text that are to complex for a students current reading level. Texts at this level will not help progress students to higher levels, conversely attempting to read at this level will demotivate students and hinder their development of reading skills.
In 3nd grade, as well as every English classroom, reading lesson and homes teachers and parents should aim at using an instructional reading level. This enables students to comprehend and therefore engage with texts with minimal assistance, and gives them the motivation to see they are doing well, but still have the support and guidance of teachers and parents.
Guided reading, for which we have many articles and resources, is an excellent way of introducing text at this levels to small groups of 3rd graders.
In fact is it very beneficial to continue guided reading at this stage as students have matured and are becoming more independent. Check out the links to know more. We have an article here on what age you can start teaching guided reading. as long as you know the 3rd grade reading levels, then this can be done in any school.
- 33%
Amazon.com
180 Days of Reading: Grade 3 - Daily Reading Workbook for Classroom and Home,...
$15.29 $22.99
BUY NOW
- 14%
Amazon.com
Educational Insights Blends & Digraphs Phonics Dominoes - Word Building...
$23.13 $26.99
BUY NOW
- 10%
Amazon.com
Phonics Flash Cards - Learn to Read in 20 Phonic Stages - Digraphs CVC Blends...
$17.99 $19.99
BUY NOW
What 3rd Graders Learn Throughout the Year.
As we mentioned above a third grader can be reading from about reading level 12 to level 25. However please don’t worry if your students or children are below this, or be to confident if they are above this.
Children will develop in their own time, and though we can help and guide them we should not push them to the point where learning , reading or any other activity becomes a chore. Keep reading fun, directed and instructional and your children and students will progress just fine.
We have a table below highlighting what the reading aims are for Grade 3. However, the TLDR version is simple: Keep them interested, develop a culture of reading, and concentrate on discovering any gaps in knowledge with levelled reading so you can target these issues.
The next section covers what skills they will learn to help them improve their reading levels through out the third grade.
Note: All children develop at very different speeds, and different learning environments will have an impact. If English is a second language, or if there is little exposure to English, or if English is seldom used outside the classroom, all will play a part.
Be assured that if you can get your hands on a levelling set or download one and get an idea of the approximate levels of your children or students, you will be able to cater for the needs in a way that is accessible and instructional to their correct levels!
Targeting in this way will help that development progress much quicker, especially in third grade when they are learning and exploring their own interests. Provide them will leveled materials and this becomes much more effective.
What Reading Skills They Will Learn in Third Grade
We mentioned in our What level should a second grader be at article, that as students get older then emphasis shifts from learning to read to reading to learn and comprehension, and higher order / critical skills start to come in to play.
In third grade, for the more advanced students especially, but for all students if in a native classroom, these higher order and critical thinking skills can be incorporated and introduced into lessons and levelled reading sessions where appropriate.
These critical thinking and reading skills are cross curricular and are so important to their future learning, yet almost criminally overlooked in the day to day bustle of classrooms. We have a workbook designed solely to help develop these skills which you can check out on the link below.
Another skill that is taught in third grade, or even earlier if feasible is the ability to judge which books are suitable for them and their reading level. This becomes more important in third grade as they learn where their interests are start to seek out reading material for themselves. It helps them judge which books are too easy and which are too difficult.
Skills Learned | Resources to Help |
Read for fun and improve fluency | Reading Grade Three Leveled Texts Set 2 and set 3 |
Development of their own reading skills, and become more aware how to use them with less prompting. | Using Syllables and Y as a Vowel Worksheets |
Stronger command of phonics, and phonetic patterns | Vowel Digraph Worksheets |
Recognition of syllables, and multiple syllable words | Using Syllables |
Be familiar with different text types, fiction, non fiction, poetry etc. | Simple Poetry Reading |
Start to develop critical thinking skills that can be applied to reading and in wider contexts | Reading Skills Workbook |
In third grade Vowels taking the form of digraph and diphthongs will be formally taught and words in 3rd grade reading material will increasingly contain them.
Longer and more complex words will be introduced with multiple syllables are in 3rd grade reading level material.
Tenses and the grammar surrounding tenses will have been introduced in the later stages of grade 2. In grade three there will be an introduction to the other tenses. We have worksheets for Future, Present and Past here for free download.
Sentences and constructing more complex sentences will become more important in 3rd grade reading levels. Reading materials will include more complex versions and teachers and parents can use reading levels to gain appropriate levels of text for their students and children.
We have some on the site for free, and in addition we also have sentence making and sentence scramble worksheets as well (link)
However some of the best ways to engage 3nd grade readers is through online games. By this time they will have become aware of tablets and phones being help in parents and siblings hands. Leveled books are one way to improve 3rd grade reading levels but its not the only tool in the box.
We have articles on some of the best online games, and have a page that has all the ones we make as well. These are free to play and very popular and certainly add motivation to your lessons! They are suitable across a wide ranger of reading levels.
What Can Teachers Do To Improve 3rd Grade Reading Levels
Teachers can improve 3rd grade reading levels by creating a love of reading in classrooms and place great emphasis in reading both in formal lessons but also in free time.
- Have a selection of levelled reading material suitable for 3rd graders covering fiction and NON fiction texts.
- Make sure there is a mix of text types and text subjects. So that many interests are covered
- Try to have a corner in the classroom for quiet reading, to be used at recess and during lessons / station activities.
- Mix up ways of presenting resources, online games, worksheets readers etc.
- Ask 3rd grade students to explore the deeper meanings of stories, the feelings and empathy they may have. Ask them what they would do, or why they think characters act the way they do.
- Display reading strategies and phonics strategies on walls for students to reference. ( also put in their day books or on desks)
- Introduce or develop 3rd grader knowledge of higher reading comprehension skills ( we have resources for this here)
- Run Guided reading lessons. (you can get information on this here)
What Language Will 3rd Grade Reading Level Books Contain?
Third grade reading level book, especially at the higher end of the lvels, will start to catian much more complext lanague.
- Language contained in reading resources will move from two syllables maximum to 3 and 4 syllable words in reading books of this level. Topics will become more complex, and use of adjectives will be more detailed.
- Synonyms will be commonly used and prefixes / suffixes and reported speech will also be more regularly sighted.
- There will be a mix of fiction and non fiction, and the comprehension questions will become more detailed.
- There will be the eliciting of opinion with answers. there will be less ”what color is the ball and more how do you think they feel type questions in 3rd grade.
- The important thing, and often forgot, is that the levels of the books remain the same. It may be that a first, second or third grader is reading them. There are not set books for different grades, there are books for different reading levels.
Our reading materials include 3 to 5 questions to help with this. These can be asked verbally or they can complete them as a worksheet post reading.
Quick Tips to help Reading in 3rd grade
This is taken from our Reading for first grade article but applies across all grades.
- Break down every word into individual letters. If there’s a combination (sh, th, ough), separate it into its own chunk. This starts to introduce syllables to students.
- Focus on words that they already know how to say. If they’re familiar with the word, they’ll be able to use contextual clues to figure out how to read it.
- Don’t study for too long. Short 15-minute study sessions hold their interest long enough to prevent reading from becoming a boring chore. Little and often is better.
- Use the resources from school and online to supplement these skills. you can access using the following links the 1000s of reading resources on our site for free and premium downloads.
How Can Parents Help Their Second Grader Develop a Love for Reading?
Parents, especially at first and second grade, play a vital role in helping your child become interested in reading. Story telling, appropriate reading resources and books in the house will all help.
In third grade your little reader will be becoming more independent, they grow up so quickly, so allowing them time to read independently and for enjoyment is one of the best things you can do.
Not every book needs teaching, not everything is a teachable moment, sometimes we all just need a little time to enjoy a good book
Here’s a list of ways that you can help your third grader develop a love for reading: It is similar to the second and first grade advice:
The books may change but the mechanics of reading levelled books do not.
- Find reading material that they’re interested in. For example, if they love dinosaurs or space , choose those books over anything else. Also allow them to choose as well. It’s not the concept that matters; It’s the words found throughout the reading that makes a big difference. We have some leveled reading material aimed at young learners here. However sites like Starfall offer online stories that may help as well.
- Offer incentives for their reading. Although the aim is to have them choose to read for fun all things start slowly and build momentum. If you can associate reading with enjoyment and reward (extrinsic in the first place) then they will start to enjoy reading and learning for its own merits. Stickers, days out, pencils all work well here.
- Picture books can keep your child’s interest . If you stop reading after 15 to 20 minutes, they’ll be begging to jump back into the material. Its great bonding time as well. Having book quizzes you have read together is a great motivator for third grader as well.
- Use alternative texts, screen magazines etc. Children can be introduced to different text types to show there are reading opportunities everywhere. Even subtitles on their favorite movies with each of you doing a voice is a great reading activity.
- Ask what your children are covering in school. If you ask their teachers they will be happy to share and offer advice on how to help your third grader progress as well as they can.
- Take a look at using online games to diversify how you introduce learning and reading.
- Lead by example, find some time each day to sit down with a book and just read, your child will learn by watching.
Children are always seeking out new opportunities to learn. Parents can simply guide them to make sure there is a little structure to their learning.
Let them choose their books but discuss with the school which level your children are to make sure it is useful for motivation for sure, but also that it is of a level where they ca understand most of it.
Using their interests to guide their reading means they are learning about topics they like and improving their reading. As they progress so with their reading levels, providing you have started them at a reasonable 3rd grade reading level book.
Finally
We have covered the average 3rd grade reading levels in native classrooms, of course there will be some difference in ESL or other classrooms. They key takeaway from all of this is that children will progress at their own speed. you can help them on their reading journey but you shouldn’t force them.
Make sure they have access to reading materials at their level, encourage them to put into use their phonics skills and comprehension skills they have learn in previous years and aim at their interests.
If you manage to achieve these things above then their ability and interest levels will only go up as they read more and more.
Reading should be a joy not a chore.
Here’s a quick recap of the post:
- 3rd grade reading levels typically fall between a 12 to 25 reading level.
- Focus on reading for fun, comprehension skills and appropriate levelled reading material.
- Follow their interests and start to let them recognize text difficultly. Taking ownership allows them to develop their own good reading habits.
- Use additional resources and activities to engage and inspire them
Sources
- Scholastic – Learn About Leveled Reading
- Reading A to Z – Levelled Books
- Amazon Second Grade Reading.
Hi I’m Marc. A teacher of over 15 years, English, General Studies and Outdoor Education. Thought it was about time to sharing both what I have learnt during that time and the resources I have put together. On this site we aim to teach the theory and share our thoughts, but also go that one step further and give you access to the hard resources you need for your class or for you children
Like this:
Like Loading. ..
Making English Fun!
I have been a teacher of English for over 15 years, in that time i made hundreds and thousands of resources and learnt so much i think its worth sharing. Hopefully to help teachers and parents around the world.
📚 Making Sense of Reading Levels plus booklists for every Grade
Books to Read • Mom StuffAugust 30, 2021
by Beth Gorden
Anyone else completely confused by reading levels? There are guided reading levels, Lexile numbers, and Book Levels like the library uses. I found this especially confusing when my kindergarten and grade 1 students were beginning to read. I assumed you just get a beginner reader, but guess what – it’s NOT that easy! Many beginner readers are actually for 3rd graders! YIKES! Don’t worry, I can explain reading levels, give you book recommendations by grade, and take all the work out of finding your child the best books to read by reading level!
Making Sense of Reading Levels
What Level Books should my Child be reading by Grade!
I think one needs a masters degree in nonsense to make sense of reading levels! Seriously there are 3 different systems used: Lexile, Book Level (like most libraries) and Guided Reading (Scholastic) that parents must try to understand. And if you google it, there isn’t much useful information out there either.
I even talked with my local librarian who gave me a lot of misinformation, ugh! So I did deeper research so I could pick out readers for my kids.
Reading levels by grade
I don’t claim to be an expert on reading levels by any means, but for all you confused parents here is some help from a mom that was just as confused as you are!
Note: All kids read at their own pace and this is just an average generalization. Please work on reading books at your child’s reading level. For kids who are great readers, they may be reading at books above their reading level.
Kindergarten Reading Level
Kindergartners are just beginning to read using some basic sight words and decoding simple words. In the library look for books labeled 0.1 – 1.3. For those using the Scholastic Guided Reading level, look for A, B, or C. (That is 25-75 in Lexile). Remember they need 30 minutes of daily reading; practice makes perfect!
- 50 Books for Kindergartners to Read by Themselves
- 45 Must Read Books for Kindergartners (Read Aloud)
First Grade Reading Level
1st Grade students are decoding more words, learning rule breaker rules, and adding more and more sight words. Through the course of the year they can be anywhere from a 1.0 – 1.9 for readers at the library. For those using Scholastic Guided Reading that is B-I or Lexile 50-275. Remember they need 30 minutes of daily reading; practice makes perfect!
- 100 Books for 1st Graders to Read Themselves
- Favorite 1st Grade Read Aloud Picture Books
- 17+ 1st Grade Read Aloud Chapter Books you won’t want to miss!
- Top 25 Chapter Book Series for 1st-3rd Grade
2nd Grade Reading Level
2nd Graders are reading well independently. Although they may start their year in advanced readers, most are ready for simple chapter books by the end of the year. Just like Kindergarten and 1st graders, they need lots of practice to continue advancing. Even though 2nd graders are reading well on their own, they still need time reading aloud to an adult who can help them correct pronunciation, flow, and check reading comprehension to ensure no issues creep up. At the library look for books labeled 1.6-2.9. Using a Guided Reading system look for H-M or 225-450 in Lexile.
- Best 2nd Grade Reading List
- 2nd Grade Read Aloud Chapter Books
- Top 25 Chapter Book Series for 1st-3rd Grade
3rd Grade Reading Level
3rd Graders are comfortable reading simple chapter books on their own. They continue to need lots of practice and time reading aloud as well. At the library look for books 2.2 – 3.9, Guided Reading level L-P, and Lexile 400-650.
- 3rd Grade Reading List
- Top 25 Chapter Book Series for 1st-3rd Grade
4th-8th Grade Reading Level
Although at this point most kids are reading chapter books that are no longer labeled with a reading level, I wanted to give you some tools in case you feel the need to further assess what your child is reading.
- 4th Grade Book List – 3.3-5.5 Book Level, O-T Guided Reading, 600-850 Lexile
- 5th Grade Reading List – 5.0-7.4 Book Level, S-W Guided Reading, 800-1000 Lexile
- 6th Grade 6.7-8.6 Book Level, V-Y Guided Reading, 950-1050 Lexile
- 7th &8th Grade 8.0-9.0 Book Level, X-Z Guided Reading, 1035-1100 Lexile
Find out any Books Reading Level
You can find out any books reading level (Lexile, library Book Level, and Scholastic Guided Reading) by checking AR Book Finder.
Free Printable Reading Logs
- Monthly Reading Log – this free printable has ‘traditional’ monthly themes
- Bookshelf Free Printable Reading Logs – super cute and fun for kids of all ages!
- Pencil Free Printable Reading Logs -print reading worksheet and color a pencil for each book you read
- Frozen Free Printable Reading Logs – kids will have fun tracking their reading and the books they’ve read with this motivating free printable for kids of all ages
- Princess Free Printable Reading Logs – students will have fun tracking their reading with these free printable reading logs
- Super Hero Free Printable Reading Logs – using a favorite theme of kids will encourage kids to read
- Cars Free Printable Book Logs – children will have fun tracking the books they’ve read with these clever free reading log
- Summer Free Printable Reading Logs – students will be motivated to read this summer with these ideas
- Reading Comprehension Bookmarks – this is a great tool for making sure kids are understanding what they are reading
- Reading Levels by Grade – how to pick the right books for every reading level and tons of printable book lists too
Book Report Idea
Looking for other ways to help kids work on reading comprehension and summarizing a book they read? Try these free resources:
- Handy Reading Comprehension Bookmarks (any book: fiction or non fiction)
- Book Report Template
- Book Report for Kids
- Pizza Book Report Idea
- Sandwich Book Report Idea
- 26 more clever Book Report Ideas
- Library Scavenger Hunt – help kids learn to navigate a library, the Dewey decimal system, book genres, and so much more with this pack of free printable scavenger hunts for kids!
- Bookshelf Reading Log – to help encourage kids to read!
Plus, here are some great ideas for Creating a Reading Nook where kids will want to curl up and read a book!
You may also like
May 2, 2018
December 8, 2020
August 5, 2021
November 2, 2015
March 10, 2020
August 30, 2021
August 29, 2020
September 25, 2015
About the author
Beth Gorden
Beth Gorden is the creative multi-tasking creator of 123 Homeschool 4 Me. As a busy homeschooling mother of six, she strives to create hands-on learning activities and worksheets that kids will love to make learning FUN! She has created over 1 million pages of printables to help teach kids ABCs, science, English grammar, history, math, and so much more! Beth is also the creator of 2 additional sites with even more educational activities and FREE printables - www.kindergartenworksheetsandgames.com and www.preschoolplayandlearn.com
L1, L2 and L3 cache. Definition - Iron on DTF
24568 views
The original is here.
Any computer processor, cheap laptop or million dollar server has a cache everywhere. And it has several levels.
Must be an important component, otherwise why is it there? What does the cache do, and why does it need several levels? What does 12-position associativity even mean?
What is a cache?
In a nutshell: This is a small but very fast memory that sits next to the logical blocks of the processor.
But of course we want to know a lot more about the cache...
Imagine an imaginary magical storage system: it's unrealistically fast, it can handle an infinite number of concurrent operations, and it always keeps data safe. If at least something remotely similar to this existed, then the design of processors would be much simpler.
The processor would only need logic modules for addition, multiplication, etc., and a system to handle the data transfer. This is due to the fact that our theoretical data storage system can send and receive all the necessary numbers instantly; none of the logical blocks will be waiting for data transfer.
But as we all know, there is no magic storage technology. Instead, we have hard drives (HDD) or solid state drives (SSD) and even the best of them are not capable of handling all the data transfers required by a conventional processor.
Great data storage elephant.
The reason modern processors are so fast is that they only need one clock cycle to add two 64-bit integer values together. For a chip with a frequency of 4 GHz, this process will take only 00000000025 seconds, or a quarter of a nanosecond.
Meanwhile, hard drives take thousands of nanoseconds to find the data, not to mention that it still needs to be transferred. And solid-state drives - tens or hundreds of nanoseconds.
Disks of this kind cannot be built into the processor, this is understandable. Otherwise, they would be physically separated. This, in turn, would only increase the time for data transfer.
The second great data storage elephant, unfortunately.
Therefore, we need another storage system that sits between the processor and the main storage. It needs to be faster than a disk, as well as be able to process a lot of data at the same time, and be much closer to the processor.
Well, we already have such a system - random access memory (RAM). And this is its main task.
Virtually all "RAM" consists of dynamic random access memory (DRAM). It is much faster than any other disk.
Although DRAM is very fast, the amount of memory leaves much to be desired.
Micron's largest DDR4 memory chips capable of storing 32 Gb or 4 GB of data. At the same time, the most capacious hard drives have a capacity of 4000 times more.
Thus, although we have increased the data transfer rate, we need to understand what is required for the processor in the first place, because the memory is very limited. These solutions are handled by hardware and software.
At least DRAM can be produced in a chip package (embedded DRAM). But the processors are quite small, so there is no way to insert a lot of memory.
10 MB RAM. To the left of the Xbox 360 GPU.
The vast majority of DRAM is located right next to the processor, which in turn is connected to the mat. board. The closest component to the processor, and yet not fast enough.
DRAM still takes about 100 nanoseconds to find data, but it is capable of transmitting it at billions of bits per second. It seems that we need another link between the processor and DRAM.
SRAM (Static Random Access Memory) enters the scene. Where DRAM uses microscopic capacitors to store data as an electrical charge, SRAM uses transistors. And they can run almost as fast as logic modules in a processor (about 10 times faster than DRAM).
SRAM has a flaw, and again it's about size.
Transistor memory takes up much more space than DRAM. 4GB DDR4 is equivalent to only 100MB SRAM. But, since the design of the CPU is similar to SRAM, it can be built into the processor itself, located as close as possible to the logical devices.
Each time you increase the speed, the storage capacity decreases. We could keep adding more sections, each one faster but smaller.
So we've come to a more technical definition of what a cache is: These are a few blocks of SRAM that are located inside the processor. They are used to keep the logical blocks busy by sending and storing data at ultra-fast speeds. Satisfied? Well, good. From now on, things get a lot more complicated!
Cache: multilevel parking
As we said, the cache is necessary because the processor does not have a magic storage system that can satisfy the data needs of the logic modules. Modern CPUs and GPUs contain a number of SRAM blocks that are organized into a hierarchy, a sequence of caches that are ordered as follows:
In the image above, the processor is represented by a black dotted box. The ALU (Arithmetic Logic Unit) is on the left. This structure powers the processor and handles the math. Technically, it's not a cache. The closest memory level to the ALU are the registers (they are grouped into a register file).
Each contains a single number, such as a 64-bit integer. Its value can be a piece of data about something, a specific instruction code, or a memory address of some other data.
The register file in the desktop processor is very small - for example, in the Intel Core i9-9900K there are two "banks" in each core. One for integers, total 180 64-bit registers. Another register file for vectors (small arrays of numbers), 168 256-bit entries. Thus, the total register file for each core is a little less than 7 KB. By comparison, the Nvidia GeForce RTX 2080 Ti streaming multiprocessor (GPU core equivalent) register file size is 256 KB.
Registers are SRAM, like cache, but they are as fast as the ALU they serve, moving data in one clock cycle. But they are not designed to store very large amounts of data (only one part), so there are always several large blocks of memory nearby: this is the 1st level cache.
Intel Skylake processor. An enlarged image of one of the nuclei.
The above image is an enlarged view of one of the Intel Skylake processor cores.
ALU and registry files are visible on the left. They are highlighted in green. At the top of the photo, in the middle, L1 cache is marked in white. It doesn't have much information, only 32 kB, but like registers, it's very close to logical blocks and runs at the same speed as them.
Another white rectangle indicates the second level 1 instruction cache, also 32 kB. As the name suggests, it stores various instructions that will be divided into smaller, so-called micro operations (usually labeled as µops). All of them will be transferred to the ALU. They also have a cache, L0, since it is smaller (only 1500 operations) and closer than the L1 cache.
You might be wondering why these SRAM blocks are so small? Why aren't they measured in megabytes? In sum, the data and instruction caches take up almost as much space on the chip as the main logic blocks. Therefore, increasing their volume would increase the overall size of the matrix.
But the main reason why they contain several KB is that the time required to find and retrieve data increases as the amount of memory increases. The L1 cache needs to be really fast, and so a trade-off between size and speed needs to be made. At best, it takes about 5 cycles (longer for floating point values) to get the data out of this cache ready for use.
L2 cache in Skylake.
If this were the only cache in the processor, its performance would suddenly come to a standstill. So they have another level of memory built into the core: the L2 cache. This is a shared block of memory that stores instructions and data.
It is always slightly larger than level 1: AMD Zen 2 processors, for example, contain up to 512 kB, so the lower level caches are in good condition. However, the additional size incurs a delay in retrieving and transferring data from this cache. It takes about twice as long as in L1.
Remembering the Intel Pentium, then the L2 cache was a separate chip that was located on a small plug-in board (for example, RAM DIMM), or was built into the motherboard. In the end, L2 did get into the processor case. Integration into the processor matrix, based on Pentium III and AMD K6-III chips.
Further development entailed another layer to support other lower levels, and this happened due to the growth of multi-core processors.
Intel Kaby Lake processor.
In this image of Intel Kaby Lake, 4 cores are shown in the middle left (the integrated GPU occupies almost half of the die, on the right). Each core has its own set of level 1 and 2 caches (highlighted in white and yellow, respectively), but they also have a third set of SRAM blocks.
The L3 cache, although it surrounds one core, is completely separate from the others. Each of them can get free access to the contents of someone else's cache of the 3rd level. It is much larger (from 2 to 32 MB), but also much slower, averaging 30 cycles, especially if the kernel needs to use data that is in a cache block that is some distance away.
Below we see one of the AMD Zen 2 cores: 32 KB L1 cache (white), 512 KB L2 cache (yellow) and a huge 4 MB L3 cache block (red).
AMD Zen 2. One of the cores.
Stop. How can 32 kB physically take up more space than 512 kB? If L1 contains so little data, why is it so much larger than L2 or L3 cache?
More than just a number
The cache improves computer performance by speeding up the transfer of data to LUNs and by storing a copy of frequently used instructions and data nearby. The information stored in the cache is divided into two parts: the data itself and the place where it was originally located in system memory / storage - this address is called the cache tag.
When the processor performs an operation to read or write data from or to memory, it starts by checking the tags in the level 1 cache. If the desired tag is present, then access to this data can be obtained almost immediately. Mismatches occur when the required tag is not at the lowest cache level.
Thus, a new tag is created in the L1 cache, and the rest of the processor takes over the search for data for this tag, through other cache levels (up to the main drive, if necessary). But in order to make room in the L1 cache for this new tag, something else must be loaded into L2.
This results in almost constant data shuffling, all achieved in just a few clock cycles. The only way to achieve this is to have a complex structure around SRAM to manage the data. To put it another way: if the processor core consisted of only one ALU, then the L1 cache would be much simpler, but since there are dozens of them (many of which will pass through two threads with instructions), the cache requires many connections to continue working.
To check the cache in your own processor, you can use free programs such as CPU-Z. But what does all this information mean? An important element is the associative set of labels - it's all about the rules applied when copying data blocks from system memory to the cache.
The above information is from Intel Core i7-9700K. Its level 1 caches are broken into 64 small blocks called sets, and each of these is further broken down into cache lines (64 bytes in size). An associative set means that a block of data from system memory is mapped to the cache line in one specific set, and not anywhere else.
"x8" tells us that one block can be associated with 8 cache lines in the set. The higher the level of associativity (i.e., the more "ways"), the more likely it is to get a cache hit while the processor is looking for data, and also reduces the number of errors caused by cache misses. The disadvantages include: overall complexity, increased power consumption, and reduced performance as more cache lines must be processed to obtain a data block.
Cache L1+L2 inclusive. L3 cache memory of the victim. Write-back policy, even ECC (error-correcting memory).
Victim cache or Victim buffer (literally Victim cache) is a small specialized cache that stores those cache lines that were recently ousted from the main microprocessor cache when they were replaced.
Another aspect of cache complexity is how data is stored at different levels. The rules are set in a so-called inclusion policy. For example, Intel Core processors have a fully inclusive L1+L3 cache. This means that the same data on the first level can also be on the third. This may seem like a waste of valuable cache memory, but there is a major benefit: if the processor misses a tag lookup at a lower level, it doesn't have to look it up at a higher level.
On the same processors, the L2 cache is not inclusive: any data stored there is not copied to any other level. This saves space, but results in the processor's memory system having to look for the missing tag in L3 (which is always much larger). The victim cache is similar, but it is used to store information that comes from a lower level - for example, AMD Zen 2 processors use the L3 victim cache, which simply stores data from L2.
There are other caching policies, such as when data is written to the cache and main system memory. This is called a write policy, and most modern processors use a write-back cache: when data is written to cache memory, there is a delay before system memory is updated with a copy of that cache. For the most part, this pause lasts as long as the data remains in the cache - only after loading does the RAM receive information.
Nvidia GA100 GPU equipped with L1 cache (20MB) and L2 cache (40MB).
For processor designers, choosing the size, type, and policy of caching is a balancing act between advanced chip capabilities and overall increased complexity and required die space. If it were possible to create a 20MB, 1000-way fully associative L1 cache, and not have the chip become the size of Manhattan (and consume the same amount of power), then everyone would have computers with these processors!
The lowest level of caching in modern processors hasn't changed much in the last decade. However, the L3 cache continues to grow in size. Ten years ago, if you were lucky enough to own a $999 Intel i7-980X, you could get 12MB of L3 cache. For half that amount today, you get 64 MB.
Cache, in a nutshell: an absolutely necessary and amazing technology. We haven't looked at other types of caches in the CPU and GPU (such as the TLB or texture cache), but since they all follow a simple structure and level pattern, you won't find it hard to figure them out.
Did you have a computer with a separate L2 cache on the motherboard? What about those Pentium II and Celeron processors (specifically the 300a) that came as daughterboards? Can you remember your first shared L3 processor? Tell us about it in the comments.
NAND vs DRAM | Network Solutions/LAN Magazine
Prices for DRAM and NAND memory continue to rise as demand for these products outstrips production volumes. What attracts customers and how does one type of memory differ from another?
Enterprise-class SSDs typically use NAND flash technology, although sometimes even data storage uses DRAM memory modules, and some companies try to combine both technologies in their system architectures.
NAND flash uses a NOT AND gate and, like many other types of memory, stores data in an array of cells, where each cell contains one or more bits of data. Dynamic Random Access Memory (DRAM), a type of volatile semiconductor random access memory (RAM), is the most widely used RAM in modern computers.
Micron Technology expects the memory market to grow 2.5 times faster than the rest of the semiconductor industry over the next three to five years. But if we analyze the history of growth in memory chips sales (see Figure 1), we can see that each peak was followed by a sharp decline, although the depth of the decline was reduced with each new cycle, as the market consolidated and demand for memory diversified from PCs to smartphones. With further diversification, this market will become less volatile.
Fig. 1. Memory module sales are very volatile, but NAND memory shipments are growing at a steady pace |
The key characteristics of DRAM SSD and NAND SSD are performance, durability and of course cost. But the main difference lies elsewhere.
ENERGY DEPENDENCE: PROBLEM AND SOLUTIONS
One of the main advantages of NAND SSD is non-volatility, that is, data is retained in memory even when the power is turned off. DRAM does not have this property, but this disadvantage can be compensated by the presence of an external UPS or a built-in battery, which is equipped with some systems and even DRAM cards.
There is also NVRAM memory, where NV stands for non-volatile. A non-volatile module with "dual" onboard NVDIMM memory combines flash memory and DRAM. In the event of a power failure, the capacitor allows data to be copied from the DRAM to the module's flash memory, and when normal operation is restored, the data is copied back to the DRAM.
For example, Micron's NVDIMM-N modules (see Figure 2) have an FPGA processor on the rail that copies data to SLC NAND in the event of a power failure, which is then provided by a supercapacitor.
Fig. 2. In 2017, Micron introduced 32GB NVDIMM-N modules. They run at DDR4-2933 and are a combination of ECC DRAM and NAND. The latter serves only for data backup |
Combining DRAM with a capacitor and flash memory can result in an efficient write cache or highly reliable server memory that can withstand power failures. Conceptually and architecturally, these storages are well combined with other non-volatile drives - HDD hard drives (see Figure 3).
Fig. 3. NAND fills the gap between HDD and DRAM |
Such memory modules, called NVDIMM-N, can be used in database servers and file storage. NVDIMM-F modules use only NAND memory, and although they have lower performance, they are non-volatile "by default" and retain data in the event of a power failure without any additional technical solutions.
PERFORMANCE
DRAM, as the mainstream RAM technology, has balanced read/write performance and is noticeably superior to NAND flash, especially in write operations. However, the cost of DRAM is much higher.
NAND-based SD is great for read-centric applications, delivering high I/O IOPS but slower write performance. This is due to the fact that in order to write a new block of data, it is necessary to completely delete the previous block.
Nevertheless, the write performance of NAND drives is still significantly higher than that of mechanical disks, and NAND device developers have spent a lot of effort and money on improving write optimization algorithms. In addition, it makes sense to compare technologies when applied to specific applications.
DURABILITY
The lifetime of NAND flash should not be judged by time of use, but by the number of operations performed. As a result of erasing and writing data, its gradual degradation occurs at the level of individual cells, which affects the overall performance and available capacity of the device. While consumer NAND drives are rated for 3,000-10,000 writes, enterprise-class flash drives can withstand up to 100,000 cycles. DRAM is 100 times faster than NAND and lasts 100 times longer.
So, unlike DRAM, flash memory wears out quite quickly with heavy use. Sometimes drives will initially have more capacity than vendors claim to help offset the performance and capacity drops. And to reduce the rate of degradation, more and more complex recording algorithms are used.
DRAM is also prone to hardware failures, and time-tested methodologies are used to compensate or correct them. DRAM does not have a write resource, but over time it degrades. Errors can be caused by a large number of factors, including overheating, prolonged use, defects, etc.?
As one field study of DRAM memory errors showed, nearly a third of all machines and more than 8% of DIMMs had at least one correctable error per year ("DRAM errors in the wild: a large-scale field study" ). On some platforms, almost half of the systems experienced correctable errors, although on average only about 1. 3% of systems were affected by uncorrectable errors (for some, this figure was 2-4%).
Error correction and detection technology comes to the rescue. The most common option is error-correcting code (ECC) memory. Another option - Dell Reliable Memory Technology PRO (RMT PRO) - is similar in concept to hard drive error correction technology. It allows you to identify fatal errors and multi-bit correctable errors in the DIMM and correct the problem. When rebooting, RMT PRO marks the defective portion of an individual DIMM, reports the defect and the location of the bad DIMM portion to the BIOS, and removes these bad cells and a small number of adjacent cells from the system's used memory pool.
What is more durable - DRAM or NAND? Both products are guaranteed to work for many years. Many NAND manufacturers provide five-year warranties, some up to 10 years. Individual DRAM-based drives have similar characteristics. It is difficult to single out any significant difference here.
USAGE SCENARIOS
Vendors typically specialize in either DRAM or NAND devices, but some vendors are starting to offer both. DRAM is most often positioned as a high-performance cache memory or as the first (fastest) level in tiered data storage (tearing) systems.
In hybrid storage pools, NAND complements DRAM. Auto-tiring software can dynamically move hot data to fast (and more expensive) SSDs from slower (but larger and relatively cheap) hard drives (see Figure 4).
Fig. 4. NAND SSDs complement HDDs and optimize storage performance/cost using auto-placement algorithms |
Analysts believe that this solid-state memory is likely to be in demand in data centers. Growth in transaction volumes, cloud computing, big data analytics, and next-generation workloads will require increased performance. Therefore, this technology will be especially useful for data centers and, to a lesser extent, for PCs.
NAND flash memory will be used for streaming data storage, batch processing, analytics tasks with database management systems. This will require the queue to grow to about 32 or more pending read/write operations.
The demand for DRAM and NAND memory is spurred on by the release of new smartphone models, the rapidly gaining popularity of cryptocurrency mining, the announcement of new processors from AMD and Intel, as well as new PCs based on them, which leads to higher prices. However, they may stabilize thanks to additional chip production launched by Samsung and SK Hynix this year.
Most IT organizations can benefit from a combination of DRAM and NAND based on architectural feasibility and cost of the solution (see Figure 5). However, in order to optimize DRAM and NAND deployments, it is useful to understand how these products differ and evaluate their prospects.
Fig. 5. Back in 2004, the cost of NAND caught up with the cost of DRAM and continued to decline until recently |
OUTLOOK 3D NAND
Both types of memory continue to evolve, with DRAM developers increasing the capacity and clock speed of memory modules, and NAND manufacturers moving towards bulk packaging (3D NAND).
For example, Intel and Micron are already setting up production of 64-layer 3D NAND memory, as well as continuing to jointly develop and manufacture 3D XPoint non-volatile memory, which can increase its competitiveness. The NAND 3D XPoint memory announced by Intel and Micron in 2015 is produced by their joint venture IM Flash Technologies (see table).
Comparison of NAND and 3D XPoint |
3D XPoint offers better performance and durability than NAND, and sits somewhere between DRAM and NAND (see table). The advent of 3D XPoint will not lead to widespread replacement of DRAM in servers, but will reduce costs by replacing part of the RAM, as well as increase the performance of NAND solid state drives.
While DRAM currently costs about $5 per gigabyte, NAND costs about 25 cents. According to Gartner, 3D XPoint will cost about $2.40 per gigabyte for large batches, which is much more expensive than NAND, and this state of affairs will continue until at least 2021.
Intel and Micron do not provide details on the technology involved. It is assumed that 3D XPoint is a type of phase change memory (PCM), since Micron has already developed such a technology (with similar properties).
3D XPoint technology delivers up to 10 times the performance of "regular" NAND (when using the PCIe/NVMe interface), while being up to 1,000 times more durable with over a million write cycles, essentially a lifetime warranty.
For comparison, today's NAND memory is designed for 3-10 thousand erase-write cycles. With the help of software for wear assessment and error correction, the number of cycles can be increased, but a million write cycles is still not achievable.
The low latency of 3D XPoint (a thousand times less than that of NAND drives) allows products based on this technology to be used for tasks characterized by high I/O load, such as transaction processing systems (see Figure 6).
Fig. 6. Combination of different types of memory / storage technologies and the resulting latency in microseconds |
3D XPoint aims to fill a gap in the data center's memory and storage hierarchy, which includes SRAM (processor-based cache), DRAM (random access memory), NAND (SSD), hard drives, tape, and optical disks. It occupies an intermediate position between DRAM and non-volatile NAND flash memory.
Intel calls its version of 3D XPoint technology Optane memory (see Figure 7). Optane is designed to serve the hottest data in the storage hierarchy, or even increase the capacity of RAM. For example, it can be used to analyze current datasets in real time, or to store and update records.
Fig. 7. VDC P4800X, Intel's first enterprise-class SSD based on 3D XPoint technology, uses PCIe NVMe 3.0 x4 interface |
In 2017, Intel began shipping products based on new technology: the 16GB/32GB Intel Optane Module for PCs and the 375GB Intel Optane SSD DC P4800X Module. This first 3D XPoint SSD can perform up to 550K read IOPS and 500K write IOPS with a queue depth of 16 or less. Like DRAM, 3D XPoint supports byte addressing, while NAND addressing occurs at the block level (see Figure 8).
Fig. 8. Intel 3D XPoint memory module used as cache memory to speed up computers with SATA drives |
According to IDC analysts, the introduction of 3D XPoint as the new storage layer is a major technological breakthrough, one of the most important since the advent of large-scale cloud data centers. Meanwhile, according to Intel, Optane-based products can be successfully used not only in data centers, but also in desktop computers to speed up data access.
The Intel Optane Module for PC functions as a cache memory to help speed up any SATA storage device on the 7th Gen Intel Core i platform. Intel claims it cuts PC boot time in half and improves overall system performance by 28%.
The DC P4800 is most effective in applications with random read/write operations and in this case acts as an extension to server DRAM. Optane performs well for random reads and writes.
DC P4800 SSD 375 GB per GB is about $4.05. The read speed of this device is 550 thousand IOPS using 4K blocks with a queue depth of 16. The sequential read-write speed is up to 2.4 and 2 GB / s, respectively.
In comparison, a NAND-based SSD, such as the 400GB Intel DC P3700, sells for $645, or $1.61 per GB. The P3700 delivers up to 450k IOPS 4K block reads at up to 128 sequential read/write queue depths (up to 2. 8 and 1.9GB/s respectively).
The Intel 3D XPoint Optane SSD has a read/write latency of less than 10µs, which is much lower than many NAND-based SSDs that range between 30µs and 100µs. Intel is considering two main use cases for the Optane DC P4800X (see Figure 9).
Fig. 9. Intel DC P4800X has a capacity of 375 GB and has much lower latency than NAND |
Intel plans to release Optane SSDs in 750GB and 1.5TB capacities with PCIe/NVMe and U.2 interfaces, and in addition, the company plans to ship Optane in the form of DRAM-style DIMMs.
Previously, the memory hierarchy was the following sequence: cache, main RAM, and disk. Hard drives have always been the biggest problem with this approach: access latencies are measured in milliseconds, orders of magnitude higher than DRAM. NAND flash has significantly lower latency than hard drives, but there is still a significant gap between NAND and DRAM. Intel Optane memory can fill the gap between DRAM and NAND, similar to how NAND sits in between DRAM and a conventional hard drive in a modern system.
Another advantage of Optane is that it provides similar performance at different queue depths. SSDs tend to work faster the greater the queue depth.
Micron also intends to gradually increase sales of its QuantX product and move to mass production in 2019. It positions QuantX SSDs as data center products, but also develops consumer-grade 3D NAND. For the end user, this means being able to analyze more data and do it in real time.
As 3D XPoint sales grow and production scales up, these drives may partially replace DRAM modules. They can be used for write caching or as a replacement / extension of RAM. In addition, for some workloads, access speed is less important than being able to store huge amounts of data in memory.
Micron announced that XPoint memory density is ten times higher than commercial DRAM products. This is true when compared to 30 nm class DRAM products, since most of these products from major DRAM manufacturers have a memory density of 0.06 GB/mm2. XPoint's first commercial product has three times the memory density of Samsung 1x DRAM, or six times that of Micron 20nm DRAM.
Gartner predicts that 3D XPoint technology will be widely used in data centers as early as the end of 2018. The data center ecosystem will have to adapt to new memory, including new chipsets and applications.
NEWS AND PLANS
The latest versions of 3D NAND contain up to 72 layers of flash memory, and manufacturers are already designing products with 96 layers (which may appear this year), and later with 128 layers. In addition, 3-bit cells (TLC) NAND are expected to be replaced by 4-bit cells (QLC). This will increase memory density and reduce manufacturing costs.
A year ago, the Chinese company Yangtze Memory Technologies announced plans to launch the production of DRAM chips with the 18-20 nm process technology and 32- and then 64-layer 3D NAND memory modules from 2018. This will allow it to compete with Micron, Samsung and SK Hynix. By 2025, China plans to expand production capacity for the manufacture of memory modules. Toshiba also intends to increase the output of 64-layer NAND memory. SK Hynix is moving from 48-layer NAND to 72-layer NAND.
K Hynix announced the completion of the development of SATA SSDs up to 4TB, which uses 3D NAND memory chips with a capacity of 512GB, consisting of 72 layers. The sequential read speed in the new SSDs reaches 560 MB / s, and writes - 515 MB / s. With random access, the read speed can be 98K, and writes - 32K IOPS. In addition, the company is developing a PCIe SSD based on 72-layer memory with a capacity of more than 1TB. Their characteristics are 2700/1100 MB / s for sequential operations and 230/350 thousand IOPS for random read / write access, respectively.
In February, the Russian GS Group announced the start of mass production of SSDs in the Kaliningrad region. As stated, these 2.5" SATA drives are based on 3D NAND flash memory from leading manufacturers. Until the end of the year, it is planned to expand the line of SSDs with models up to 1 TB. The first - with a capacity of 256 GB - has a sequential read and write speed of 550 and 450 MB / s, respectively. And these are just some of the latest innovations (see Figure 10). Their appearance is facilitated by high demand from manufacturers of smartphones and servers for data centers.
Fig. 10. Patriot recently released NVMe SSDs based on the new Phison E12 controller supporting up to eight NAND lanes and PCIe 3.0 x4 interface. The novelty is based on 64-layer BICS 3D NAND memory from Toshiba. The capacity of its Viper SSD ranges from 240 GB to 2 TB. 3200MB/s sequential read, 3000MB/s sequential write, and 600K random read/write IOPS |
Samsung's DRAM modules are manufactured using an 18nm process. Micron and SK Hynix are planning to implement 10nm technology standards, but there are many hurdles to overcome along the way. Meanwhile, Samsung is already mastering the 7nm process technology.
amsung electronics remains the market leader in flash memory. This year, it aims to accelerate the launch of high-density NAND products, expand the supply of high-capacity drives in the entry and mid-range segment, as well as enterprise-class drives with PCIe and NVMe interfaces.
The second place is occupied by Toshiba, which has focused on the supply of solid-state drives with a PCIe interface. The company intends to increase the production of NAND flash memory and increase the capacity for the production of 64-layer 3D NAND chips.
The leaders are followed by Western Digital, Micron, SK Hynix and Intel. All of them are successfully increasing sales and developing production for the production of 3D NAND memory chips.
At the same time, the development of conventional NAND flash memory will continue until at least 2025. Flash memory technologies are evolving at such a rapid pace that the whole concept of storage is changing dramatically (see Dmitry Ganzhi's article "Flash Time, or Towards Universal Memory" in the March 2017 issue of the Journal of Network Solutions / LAN).