OSDev.org

The Place to Start for Operating System Developers
It is currently Thu Mar 28, 2024 5:56 am

All times are UTC - 6 hours




Post new topic Reply to topic  [ 7 posts ] 
Author Message
 Post subject: Implement basic FAT32 file system
PostPosted: Wed Feb 13, 2019 11:40 am 
Offline

Joined: Wed Jan 02, 2019 5:18 am
Posts: 4
In my project i need to implement a simple operating system.
One of the modulus in my operating system is a File System that will able to read + write files from/to disk.
Can you suggest me which FS implement ? I thought about FAT32 but i didn't find a simple implementation.
Can you suggest me any sources ? examples ?
I need really simple FS, just read write functionality without VFS.


Top
 Profile  
 
 Post subject: Re: Implement basic FAT32 file system
PostPosted: Wed Feb 13, 2019 11:55 am 
Offline
Member
Member
User avatar

Joined: Sat Mar 31, 2012 3:07 am
Posts: 4591
Location: Chichester, UK
FAT16 and ext2 are both fairly simple. There is a wealth of information about them on the Internet.


Top
 Profile  
 
 Post subject: Re: Implement basic FAT32 file system
PostPosted: Wed Feb 13, 2019 12:02 pm 
Offline
Member
Member
User avatar

Joined: Fri Oct 27, 2006 9:42 am
Posts: 1925
Location: Athens, GA, USA
I try to get this out to all new members - either by PM, or in a thread - to get everyone started on the same footing. In this instance, at least part of the information you need is linked to near the end of the post, as part of the usual suggestions. I hope this helps.
----------------------------------

The first thing I want to say is this: if you aren't already using version control for all software projects you are working on, drop everything and start to do that now. Set up a VCS such as Git, Subversion, Mercurial, Bazaar, or what have you - which you use is less important than the fact that you need to use it. Similarly, setting up your repos on an offsite host such as Gitlab, Github, Sourceforge, CloudForge, or BitBucket should be the very first thing you do whenever you start a new project, no matter how large or small it is.

If nothing else, it makes it easy to share your code with us on the forum, as you can just post a link, rather than pasting oodles and oodles of code into a post.

Once you have that out of the way (if you didn't already), you can start to consider the OS specific issues.

If you haven't already, I would strongly advise you to read the introductory material in the wiki:


After this, go through the material on the practical aspects of
running an OS-dev project:

I strongly suggest that you read through these pages in detail, along with the appropriate ones to follow, before doing any actual development. These pages should ensure that you have at least the basic groundwork for learning about OS dev covered.

This brings you to your first big decision: which platform, or platforms, to target. Commonly options include:
  • x86 - the CPU architecture of the stock PC desktops and laptops, and the system which remains the 'default' for OS dev on this group. However, it is notoriously quirky, especially regarding Memory Segmentation, and the sharp divisions between 16-bit Real Mode, 16-bit and 32-bit Protected Modes, and 64-bit Long Mode.
  • ARM - a RISC architecture widely used on mobile devices and for 'Internet of Things' and 'Maker' equipment, including the popular Raspberry Pi and Beagleboard single board computers. While it is generally seen as easier to work with that x86, most notably in the much less severe differences in between the 32-bit and 64-bit modes and the lack of memory segmentation, the wiki and other resources don't cover it nearly as well (though this is changing over time as it becomes more commonly targeted).
  • MIPS, another RISC design which is slightly older than ARM. It is one of the first RISC design to come out, being part of the reason the idea caught on, and is even simpler than ARM in terms of programming, though a bit tedious when it comes to assembly programming. While it was widely used in workstations and game consoles in the 1990s, it has declined significantly due to mismanagement by the owners of the design, and is mostly seen in devices such as routers. There are a handful of System on Chip single-board computers that use it, such as the Creator Board and the Onion Omega2, and manufacturers in both China and Russia have licensed the ISA with the idea of breaking their dependence on Intel. Finding good information on the instruction set is easy, as it is widely used in courses on assembly language and computer architecture and there are several emulators that run MIPS code, but finding usable information on the actual hardware systems using it is often difficult at best.
  • RISC-V is an up and coming open source hardware ISA, but so far is Not Ready For Prime Time. This may change in the next few years, though.

You then need to decide which Language to use for the kernel. For most OS-Developers this means knowing and using C; while other languages can be used, it is important to know how to read C code, even if you don't use C, as most OS examples are written in it. You will also need to know at least some assembly language for the target platform, as there are always parts of the kernel and the device drivers which cannot be done in high-level languages.

You further need to choose the compiler, assembler, linker, build tool, and support utilities to use - what is called the 'toolchain' for your OS. For most platforms, there aren't many to choose from, and the obvious choice would be GCC and the Binutils toolchain due to their ubiquity. However, on the Intel x86 platform, it isn't as simple, as there are several other toolchains which are in widespread use for it, the most notable being the Microsoft one - a very familiar one to Windows programmers, but one which presents problems in OSDev. The biggest issue with Visual Studio, and with proprietary toolchains in general, is that using it rules out the possibility of your OS being "self-hosting" - that is to say, being able to develop your OS in the OS itself, something most OSdevs do want to eventually be able to do. The fact that Porting GCC to your OS is feasible, whereas porting proprietary x86 toolchains isn't, is a big factor in the use Binutils and GCC, as it their deep connection to Linux and other Unix derivatives.

Regardless of the high-level language you use for OS dev (if any), you will still need to use assembly language, which means choosing an assembler. If you are using Binutils and GCC, the obvious choice would be GAS, but for x86 especially, there are other assemblers which many OSdevs prefer, such as Netwide Assembler (NASM) and Flat Assembler (FASM).

The important thing here is that assembly language syntax varies more among the x86 assemblers than it does for most other platforms, with the biggest difference being that between the Intel syntax used in the majority of x86 assemblers, and the AT&T syntax used in GAS. You can see an overview of the differences on the somewhat misnamed wiki page Opcode syntax. While it is possible to coax GAS to use the Intel syntax using the .intel_syntax noprefix directive, the opposite is generally not true for Intel-based assemblers such as NASM, and even with that directive, GAS is still quite different from other x86 assemblers in other regards.

It is still important to understand that the various Intel syntax assemblers - NASM, FASM, and YASM among others - have differences in how they handle indexing, in the directives they use, and in their support for features such as macros and defining data structures. While most of these follow the general syntax of Microsoft Assembler (MASM), they all diverge from it in various ways.

Once you know which platform you are targeting, and the toolchain you want to use, you need to understand them. You should read up on the core technologies for the platform. Assuming that you are targeting the PC architecture, this would include:

This leads to the next big decision: which Bootloader to use. There are a number of different standard bootloaders for x86, with the most prominent being GRUB. We strong recommend against Rolling Your Own Bootloader, but it is an option as well.

You need to consider what kind of File System to use. Common ones used when starting out in OS dev include:

We generally don't recommend designing your own, but as with boot loaders, it is a possibility as well.

While this is a lot of reading, it simply reflects the due diligence that any OS-devver needs to go through in order to get anywhere. OS development, even as a simple project, is not amenable to the Stack Overflow cut-and-paste model of software development; you really need to understand a fair amount of the concepts and principles before writing any code, and the examples given in tutorials and forum posts generally are exactly that. Copying an existing code snippet without at least a basic idea of what it is doing simply won't do. While learning itself is an iterative process - you learn one thing, try it out, see what worked and what didn't, read some more, etc. - in this case a basic foundation is needed at the start. Without a solid understanding of at least some of the core ideas before starting, you simply can't get very far in OS dev.

Hopefully, this won't scare you off; it isn't nearly as bad as it sounds. It just takes a lot of patience and a bit of effort, a little at a time.

_________________
Rev. First Speaker Schol-R-LEA;2 LCF ELF JAM POEE KoR KCO PPWMTF
Ordo OS Project
Lisp programmers tend to seem very odd to outsiders, just like anyone else who has had a religious experience they can't quite explain to others.


Last edited by Schol-R-LEA on Wed Feb 13, 2019 3:21 pm, edited 1 time in total.

Top
 Profile  
 
 Post subject: Re: Implement basic FAT32 file system
PostPosted: Wed Feb 13, 2019 2:57 pm 
Offline
Member
Member

Joined: Wed Dec 12, 2018 12:16 pm
Posts: 119
Here's the FAT filesystem documentation: http://www.osdever.net./documents/fatgen103.pdf
Also read this: https://wiki.osdev.org/FAT32
Maybe is useful for you, or who knows...


Top
 Profile  
 
 Post subject: Re: Implement basic FAT32 file system
PostPosted: Wed Feb 13, 2019 3:40 pm 
Offline
Member
Member

Joined: Tue Aug 30, 2016 1:31 pm
Posts: 69
On which medium is your OS on?
for USB/Floppy I personally go for FAT12 since it is very simple


Top
 Profile  
 
 Post subject: Re: Implement basic FAT32 file system
PostPosted: Sat Feb 16, 2019 7:21 pm 
Offline
Member
Member

Joined: Fri May 11, 2018 6:51 am
Posts: 274
Rocobo wrote:
In my project i need to implement a simple operating system.
One of the modulus in my operating system is a File System that will able to read + write files from/to disk.
Can you suggest me which FS implement ? I thought about FAT32 but i didn't find a simple implementation.
Can you suggest me any sources ? examples ?
I need really simple FS, just read write functionality without VFS.


Hi Rocobo,
the best way for me to learn FAT16/32 is to read carefully the fatgen103.pdf document as suggested by hextakatt. It’s Microsoft's official documentation, written extremely well and using a simple language. I used that document for implementing support for FAT16 and FAT32 in my project, Tilck.

Said that, if you want a simple FAT implementation example, you can check mine:
https://github.com/vvaltchev/tilck/blob ... t32_base.c
https://github.com/vvaltchev/tilck/blob ... t32_base.h

It supports only reading a FAT filesystem and only ascii long filenames, but it is really simple: no VFS, no I/O. Those files just assume you have somewhere in memory a whole FAT partition loaded and are intentionally not entangled with the rest of my code because they are shared between the kernel and the legacy bootloader. That’s why they are so minimalistic. The only things they use from the rest of the project are utils like asserts and string funtions like memcpy, strlen etc. For a simple usage example search for the load_elf_kernel function in the legacy bootloader.

Final note: I hope you won’t copy-paste my code because you’ll loose the whole educational purpose of learning how FAT works. Personally, I enjoyed doing that so much. But if you do copy it (or part of it), please add somewhere in your project a notice file mentioning where the original code comes from (BSD license).

I hope I’ve helped you somehow.

Vlad

_________________
Tilck, a Tiny Linux-Compatible Kernel: https://github.com/vvaltchev/tilck


Top
 Profile  
 
 Post subject: Re: Implement basic FAT32 file system
PostPosted: Sun Feb 17, 2019 10:26 am 
Offline
Member
Member
User avatar

Joined: Thu Oct 13, 2016 4:55 pm
Posts: 1584
Hi,
Rocobo wrote:
Can you suggest me any sources ? examples ?
For a very simplest implementation I can recommend my FAT tutorial, less than 100 SLoC. It is the bare minimum, no unicode long filenames, only legacy 8+3 ones etc. but it can dynamically detect and use FAT16 and FAT32.
Code:
int fat_getpartition(void);                 // reads the partitioning table and checks if the first partition is a FAT16 or FAT32.
unsigned int fat_getcluster(char *fn);      // locates the root directory entry for "fn" (8+3 string) and returns the starting cluster number
char *fat_readfile(unsigned int cluster);   // reads a file entirely into memory and returns the memory buffer
The source is part of an AArch64 tutorial, but there's nothing architecture specific about FAT, just replace "sd_readblock()" with your sector reader function.

Otherwise I'd recommend to use one of the well known libraries for embedded systems:
- http://elm-chan.org/fsw/ff/00index_e.html (FatFs is a standalone ANSI C library, which has a great community)
- https://www.esol.com/embedded/prfile2.html
- https://code.google.com/archive/p/fat16lib/downloads (FAT16 only)
- https://github.com/topics/fat (list FAT related projects on github)

Cheers,
bzt


Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 7 posts ] 

All times are UTC - 6 hours


Who is online

Users browsing this forum: DotBot [Bot], Google [Bot] and 51 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group