【Issue 24】Apache DolphinScheduler Weekly FAQ
September 16th-September 22nd
Q: When deploying DolphinScheduler on Kubernetes, what should I do if the repository address https://raw.githubusercontent.com/bitnami/charts/archive-full-index/bitnami cannot be found?
A: It should be accessible; refer to https://github.com/bitnami/charts/issues/10833 for more information.
Q: Can DolphinScheduler pass the namespace during task execution on Kubernetes nodes instead of choosing a fixed one from a dropdown?
A: Currently, it’s not supported, and you need to modify the code yourself.
Q: Is a low-code workflow more business-oriented than Flink’s workflow? Can Flink and DolphinScheduler replace each other in certain scenarios, just like Airflow and Dags?
A: DolphinScheduler and Flink serve different purposes. DolphinScheduler is for scheduling while Flink is for stream processing. DolphinScheduler can schedule Flink jobs, but the reverse is not true.
Q: In DolphinScheduler 3.1.8, how can I retrieve task and workflow information for alerting using scripts?
A: It’s not possible to obtain this information.
Q: Are there plans to upgrade to JDK 17 and Spring Boot 3.x versions?
A: There are no such plans currently.
Q: In DolphinScheduler 2.0.8, I’m passing output parameters in upstream SQL and trying to insert them in downstream SQL as shown in the image, but the downstream cannot receive the passed parameters. Any suggestions?
A: I’m not familiar with the 2.0.x version, but it’s supported in 3.0.x. If 2.0.x doesn’t support it, try merging the two SQL statements into one in a single task.
Q: Where can I find the release notes for each version of DolphinScheduler?
A: You can find them at https://github.com/apache/dolphinscheduler/releases.
Q: Does DolphinScheduler have loop nodes, or is there a way to loop through a specific node?
A: You can reduce the timer delay and use parallelism. Alternatively, you can write a loop in a shell or Python script.
Q: How can DolphinScheduler pass a list as a parameter between tasks?
A: Use the format ["val1", "val2", "val3"].
Q: Are there plans to support Windows versions of the worker in the future?
A: Starting from version 3.2.0, it can run on Windows. We added support for executing Windows shell scripts: https://github.com/apache/dolphinscheduler/pull/14582.
Q: How can I resolve Chinese character encoding issues in the output logs?
A: Set the operating system and database encoding to UTF-8.
Q: In DolphinScheduler 3.1.2, when integrating Minio as a resource storage, if using https, it reports an error with the IP and port. What should be done if Minio uses HTTPS?
A: Currently, only HTTP is supported.
Q: Can DolphinScheduler penalize an alert group based on the return value of a shell task?
A: You can directly send emails within the script. The current alerts are focused on the flow instance level. If you want to alert at the task instance level, you can try adding it in the taskFinished method.
Q: Does DolphinScheduler 3.1.7 have the concept of folder-level permissions for resource authorization (i.e., permissions to perform any operation on any file in a folder), or is it limited to files only?
A: It’s limited to files only.
Q: In DolphinScheduler, when submitting Spark SQL type tasks, there are only local and clientmodes. In which version does it support clustermode?
A: You can directly submit in cluster mode using a shell.
Q: When using Python tasks to invoke PowerShell scripts involving remote machine login passwords, how can password security be ensured?
A: Have a dedicated worker on a separate Linux tenant to store the password in a file accessible only by that tenant. Alternatively, for less stringent security requirements, you can store it as an environment variable within the DolphinScheduler environment.
Q: During early morning scheduling, when multiple tasks execute simultaneously, can I set parallelism?
A: There are resource pools to control concurrency.
Join the Community
Welcome to fill out this form to be a speaker of Apache DolphinScheduler: https://forms.gle/MS2fQDhG4n9Hh2yv5:)
There are many ways to participate and contribute to the DolphinScheduler community, including:
Documents, translation, Q&A, tests, codes, articles, keynote speeches, etc.
We assume the first PR (document, code) to contribute to be simple and should be used to familiarize yourself with the submission process and community collaboration style.
So the community has compiled the following list of issues suitable for novices: https://github.com/apache/dolphinscheduler/contribute
List of non-newbie issues:
https://github.com/apache/dolphinscheduler/issues?q=is%3Aopen+is%3Aissue+label%3A%22help+wanted%22+
How to contribute:
GitHub Code Repository: https://github.com/apache/dolphinscheduler
Official Website:https://dolphinscheduler.apache.org/
Mail List:dev@dolphinscheduler@apache.org
Twitter:@DolphinSchedule
YouTube:https://www.youtube.com/@apachedolphinscheduler
Slack:https://s.apache.org/dolphinscheduler-slack
Contributor Guide:https://dolphinscheduler.apache.org/en-us/community/index.html
Your Star for the project is essential, don’t hesitate to lighten a Star for Apache DolphinScheduler ❤️
