• 0 Posts
  • 17 Comments
Joined 1 year ago
cake
Cake day: July 14th, 2024

help-circle
  • Tflops is a generic measurement, not actual utilization, and not specific to a given type of workload. Not all workloads saturate gpu utilization equally and ai models will depend on cuda/tensor. the gen/count of your cores will be better optimized for AI workloads and better able to utilize those tflops for your task. and yes, amd uses rocm which i didn’t feel i needed to specify since its a given (and years behind cuda capabilities). The point is that these things are not equal and there are major differences here alone.

    I mentioned memory type since the cards you listed use different versions ( hbm vs gddr) so you can’t just compare the capacity alone and expect equal performance.

    And again for your specific use case of this large MoE model you’d need to solve the gpu-to-gpu communication issue (ensuring both connections + sufficient speed without getting bottlenecked)

    I think you’re going to need to do actual analysis of the specific set up youre proposing. Good luck




  • Pihole can set up “groups” for different blocklists. You specify client by IP or MAC address so it doesnt matter what the dhcp server is, so long as there’s a static IP or static MAC address. My pihole server doesn’t have dhcp set up and I’m able to do this fine

    Though from personal experience this just becomes a game of cat and mouse, and if you have a motivated teenager then they will find a way to circumvent this. For example android can rotate MAC addresses, and IP addresses are trivial to spoof as well.



  • I submitted a response but if i may give some feedback, the second portion brings up:

    I am willing to pay a substantial amount for hardware required for self-hosting.

    This seemed out of place because there were no other value related questions (iirc). Such as:

    • I believe self hosting saves me money in the short term
    • i believe self hosting saves me money in the long run

    I’m sure you could also think of more. But i think it’s pretty important because between cloud service providers and any non-free apps you want to use, it can be quite costly compared to the cost of some hardware and time it takes to set things up.

    The rest of my responses don’t change but if you’re wanting to understand the impact of money in all of this, i think some more questions are needed

    Best of luck!




  • Foundry was the 2nd thing i started self hosting (the first being pihole). Have had it running for 5 years now.

    Other than that i only recently started expanding my self hosting:

    • tandoor recipes
    • navidrome (for music, mentioning it since it isn’t the typical media server recommendation)
    • personal knowledge management (pkm) static website that i build with hugo
    • umami analytics
    • Remark42 for comment system on one of my internal static websites
    • a few smaller things that i built. One is a discord bot from before i started hating discord, and then a few web apps that i haven’t open sourced yet







  • Im not familiar with doku wiki but here’s a few thoughts

    • privacy policy is good to have regardless of what you do with rest of my comments
    • your site is creating a cookie “dokuwiki” for user tracking.
    • cookie is created regardless of user agreement, rather than waiting for acceptance (implied or explicit agreement). As in i visit the page, i click nothing and i already have the dokuwiki cookie.
    • i like umami analytics for a cookieless google analytics alternative. They have a generous free cloud option for hobby users and umami is also self hostable. Then you can get rid of any banner.

  • tldr - lesson learned. buy a new domain and move over to it.

    but for those who want to learn something new - you are only renting your domains. If you fail to pay by the registration date then you generally get a grace period to pay more money to renew it. If you fail to pay before that period expires then the domain will be released. Some companies like godaddy will automatically buy the domain for another year (or more). But even if Godaddy doesn’t then it still goes up on a list of expiring domains and there are backorder services that will try to buy the domain or auction them off.

    So in the end it doesn’t really matter what registrar you use. If you do not pay, it goes back to a list where people can see it is expiring and then you’ll get some people who either want to legitimately use that domain or more likely they are wanting to try to sell it to you or someone else for more than they buy it for.

    And I saw someone mention file a complaint. I’m sorry to say that if you did not have money to renew the domain then you aren’t going to be able to do that either. This is called Uniform Domain Name Dispute Resolution Policy (UDRP) and the fee is between $1500-4000 for 1 to 5 domains.. Additionally, just because you file a complaint does not mean the issue will be resolved favorably or timely. These complaints can last years, and there is no guarantee you will get the domain back.

    This is why you should always pay your domain rental fee. And if you don’t, then you need to either be willing to pay a ton of money to get it back or you will need to move on. Sorry its a tough lesson to learn but if you’re just a student then you probably weren’t using this to run a business or anything so in the end you are quite fortunate.