Mdthbs

Is there a radar system monitoring the UK mainland border?

Is it a good security practice to force employees hide their employer to avoid being targeted?

What do you call the action of "describing events as they happen" like sports anchors do?

How can calculate the turn-off time of an LDO?

Print "N NE E SE S SW W NW"

Why did the Death Eaters wait to reopen the Chamber of Secrets?

What did the 8086 (and 8088) do upon encountering an illegal instruction?

Is it good practice to create tables dynamically?

Why is it bad to use your whole foot in rock climbing

How can religions without a hell discourage evil-doing?

What is the language spoken in Babylon?

Is tuition reimbursement a good idea if you have to stay with the job

Does the UK delegate some immigration control to the Republic of Ireland?

Why didn't all the iron and heavier elements find their way to the center of the accretion disc in the early solar system?

How do I type a hyphen in iOS 12?

Fastest way from 8 to 7

Why would a home insurer offer a discount based on credit score?

Can I get a photo of an Ancient Arrow?

Realistic, logical way for men with medieval-era weaponry to compete with much larger and physically stronger foes

Are athlete's college degrees discounted by employers and graduate school admissions?

I sent an angry e-mail to my interviewers about a conflict at my home institution. Could this affect my application?

Does WiFi affect the quality of images downloaded from the internet?

Is plausible to have subspecies with & without separate sexes?

Simple log rotation script

Good filesystem to manage space efficiently

How to set up ZFS with ZIL and L2ARC SSD?What is the order in which physical volumes are used in a volume group?Can I get SSD rw performance while keeing data security if I combine SSD & HDD in btrfs RAID1Combining SSD + HDD into single fast, large partition?Reliability of ZFS/ ext4 on ZVOL, used not for performance but for transparent compression, on low memory system?Why don't LVM and RAID require a clustered filesystemmoving only some directories / filesystems to ZFS datasetsSpan BTRFS over multiple partitions to increase disk spaceFreeBSD can't mount home partitionUnable to explain zfs referenced after rsync

.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty{ margin-bottom:0;
}

1

Quick question: is there a filesystem that let me

1. automatically "resize" (up or down) partitions,


2. share one partition between several devices, and


3. make sure that some content only go to one device and not the other?

Context:
I have two drives: a big HDD (1 TB) that I trust, and a very small SSD (24 GB) that I do not trust (i.e. it could be destroyed at any time, but this should not corrupt the data on the HDD). To simplify, let's say I have two folders only:

• /nix will contain the system: I don't mind if I lose this partition, so I'd like to have it as much as possible on the SSD to launch new apps quickly. But '/nix' could contain more that 24 GB of data, so it needs to be partly on the HDD as well.




• /home will contain the data: it contains valuable data that I do not want to put on the SSD to make sure I don't lose them in case of a corruption of the SSD.

For now, I created 3 LVM partitions (physical volumes): two partitions on the HDD (hdda, hddb), and one the SDD (sdda), and I created two LWM group volumes, one that contains hdda + sdda (for the ext4 partition /nix), and one that contains hddb (for the ext4 partition/home). But the problem is that the total size of /nix + /home is always close to the maximum available size, so when I need more memory on /home, I need to shrink down /nix. And shrinking a partition is not super practical, as it requires to boot from a live CD, and takes time...

I saw that the very poverful ZFS (that even allows compression!) can automatically "resize" the partition for me, but unfortunately I can't find how to say "keep the /home partition in HDD, and keep the /nix partition in SDD if possible".

Is there any better filesystem that allows that (compression would be nice as well), or a way to use ZFS in that manner?

Thanks!

filesystems btrfs zfs

share|improve this question

edited 26 mins ago

tobiasBora

asked 2 hours ago

tobiasBoratobiasBora

372313

add a comment | 

1

Quick question: is there a filesystem that let me

1. automatically "resize" (up or down) partitions,


2. share one partition between several devices, and


3. make sure that some content only go to one device and not the other?

Context:
I have two drives: a big HDD (1 TB) that I trust, and a very small SSD (24 GB) that I do not trust (i.e. it could be destroyed at any time, but this should not corrupt the data on the HDD). To simplify, let's say I have two folders only:

• /nix will contain the system: I don't mind if I lose this partition, so I'd like to have it as much as possible on the SSD to launch new apps quickly. But '/nix' could contain more that 24 GB of data, so it needs to be partly on the HDD as well.




• /home will contain the data: it contains valuable data that I do not want to put on the SSD to make sure I don't lose them in case of a corruption of the SSD.

For now, I created 3 LVM partitions (physical volumes): two partitions on the HDD (hdda, hddb), and one the SDD (sdda), and I created two LWM group volumes, one that contains hdda + sdda (for the ext4 partition /nix), and one that contains hddb (for the ext4 partition/home). But the problem is that the total size of /nix + /home is always close to the maximum available size, so when I need more memory on /home, I need to shrink down /nix. And shrinking a partition is not super practical, as it requires to boot from a live CD, and takes time...

I saw that the very poverful ZFS (that even allows compression!) can automatically "resize" the partition for me, but unfortunately I can't find how to say "keep the /home partition in HDD, and keep the /nix partition in SDD if possible".

Is there any better filesystem that allows that (compression would be nice as well), or a way to use ZFS in that manner?

Thanks!

filesystems btrfs zfs

share|improve this question

edited 26 mins ago

tobiasBora

asked 2 hours ago

tobiasBoratobiasBora

372313

add a comment | 

Quick question: is there a filesystem that let me

1. automatically "resize" (up or down) partitions,


2. share one partition between several devices, and


3. make sure that some content only go to one device and not the other?

Context:
I have two drives: a big HDD (1 TB) that I trust, and a very small SSD (24 GB) that I do not trust (i.e. it could be destroyed at any time, but this should not corrupt the data on the HDD). To simplify, let's say I have two folders only:

• /nix will contain the system: I don't mind if I lose this partition, so I'd like to have it as much as possible on the SSD to launch new apps quickly. But '/nix' could contain more that 24 GB of data, so it needs to be partly on the HDD as well.




• /home will contain the data: it contains valuable data that I do not want to put on the SSD to make sure I don't lose them in case of a corruption of the SSD.

For now, I created 3 LVM partitions (physical volumes): two partitions on the HDD (hdda, hddb), and one the SDD (sdda), and I created two LWM group volumes, one that contains hdda + sdda (for the ext4 partition /nix), and one that contains hddb (for the ext4 partition/home). But the problem is that the total size of /nix + /home is always close to the maximum available size, so when I need more memory on /home, I need to shrink down /nix. And shrinking a partition is not super practical, as it requires to boot from a live CD, and takes time...

I saw that the very poverful ZFS (that even allows compression!) can automatically "resize" the partition for me, but unfortunately I can't find how to say "keep the /home partition in HDD, and keep the /nix partition in SDD if possible".

Is there any better filesystem that allows that (compression would be nice as well), or a way to use ZFS in that manner?

Thanks!

filesystems btrfs zfs

share|improve this question

edited 26 mins ago

tobiasBora

asked 2 hours ago

tobiasBoratobiasBora

372313

share|improve this question

edited 26 mins ago

tobiasBora

asked 2 hours ago

tobiasBoratobiasBora

372313

share|improve this question

edited 26 mins ago

tobiasBora

asked 2 hours ago

tobiasBoratobiasBora

372313

asked 2 hours ago

tobiasBoratobiasBora

372313

asked 2 hours ago

tobiasBoratobiasBora

372313

1 Answer
1

active

oldest

votes

1

just make one big LV with the 2 spinning disks, and add the SSD as a lvmcache.

http://man7.org/linux/man-pages/man7/lvmcache.7.html

Other options;

Btrfs, SeaweedFS

https://en.m.wikipedia.org/wiki/Comparison_of_file_systems

https://en.m.wikipedia.org/wiki/Comparison_of_distributed_file_systems

share|improve this answer

edited 40 mins ago

answered 46 mins ago

user1133275user1133275

3,9751925

• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  Thanks for your answer. I was considering at some points zfs's l2arc method that are similar, but the cache was lost at every reboot, which makes it pointless for quick boot. Does lvmcache also lose cache at startup? The second problem of this approach is that I lose 25Gb of space due to the duplication on the HDD and SDD.
  
  – tobiasBora
  18 mins ago
  
  
  

  
  
  
  

add a comment | 

Your Answer

StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "106"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});

function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});


}
});

draft saved

draft discarded

Sign up or log in

StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});

Sign up using Google

Sign up using Facebook

Sign up using Email and Password

Post as a guest

Name

Email

Required, but never shown

StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f524323%2fgood-filesystem-to-manage-space-efficiently%23new-answer', 'question_page');
}
);

Post as a guest

Name

Email

Required, but never shown

1

just make one big LV with the 2 spinning disks, and add the SSD as a lvmcache.

http://man7.org/linux/man-pages/man7/lvmcache.7.html

Other options;

Btrfs, SeaweedFS

https://en.m.wikipedia.org/wiki/Comparison_of_file_systems

https://en.m.wikipedia.org/wiki/Comparison_of_distributed_file_systems

share|improve this answer

edited 40 mins ago

answered 46 mins ago

user1133275user1133275

3,9751925

• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  Thanks for your answer. I was considering at some points zfs's l2arc method that are similar, but the cache was lost at every reboot, which makes it pointless for quick boot. Does lvmcache also lose cache at startup? The second problem of this approach is that I lose 25Gb of space due to the duplication on the HDD and SDD.
  
  – tobiasBora
  18 mins ago
  
  
  

  
  
  
  

add a comment | 

1

just make one big LV with the 2 spinning disks, and add the SSD as a lvmcache.

http://man7.org/linux/man-pages/man7/lvmcache.7.html

Other options;

Btrfs, SeaweedFS

https://en.m.wikipedia.org/wiki/Comparison_of_file_systems

https://en.m.wikipedia.org/wiki/Comparison_of_distributed_file_systems

share|improve this answer

edited 40 mins ago

answered 46 mins ago

user1133275user1133275

3,9751925

• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  Thanks for your answer. I was considering at some points zfs's l2arc method that are similar, but the cache was lost at every reboot, which makes it pointless for quick boot. Does lvmcache also lose cache at startup? The second problem of this approach is that I lose 25Gb of space due to the duplication on the HDD and SDD.
  
  – tobiasBora
  18 mins ago
  
  
  

  
  
  
  

add a comment | 

just make one big LV with the 2 spinning disks, and add the SSD as a lvmcache.

http://man7.org/linux/man-pages/man7/lvmcache.7.html

Other options;

Btrfs, SeaweedFS

https://en.m.wikipedia.org/wiki/Comparison_of_file_systems

https://en.m.wikipedia.org/wiki/Comparison_of_distributed_file_systems

share|improve this answer

edited 40 mins ago

answered 46 mins ago

user1133275user1133275

3,9751925

share|improve this answer

edited 40 mins ago

answered 46 mins ago

user1133275user1133275

3,9751925

answered 46 mins ago

user1133275user1133275

3,9751925

answered 46 mins ago

user1133275user1133275

3,9751925