Airflow Standalone Cannot use relative path: - airflow
I just installed Airflow 2.3.0 using the command
pip install "apache-airflow==2.3.0" --constraint "https://raw.githubusercontent.com/apache/airflow/constraints-2.3.0/constraints-3.8.txt"
in a virtual environment. Then tried running airflow standalone as specified in the official documentation here: https://airflow.apache.org/docs/apache-airflow/stable/installation/installing-from-pypi.html
But I keep getting this error:
standalone | Starting Airflow Standalone
standalone | Checking database is initialized
INFO [alembic.runtime.migration] Context impl SQLiteImpl.
INFO [alembic.runtime.migration] Will assume non-transactional DDL.
INFO [alembic.runtime.migration] Running upgrade -> e3a246e0dc1, current schema
INFO [alembic.runtime.migration] Running upgrade e3a246e0dc1 -> 1507a7289a2f, Add ``is_encrypted`` column in ``connection`` table
INFO [alembic.runtime.migration] Running upgrade 1507a7289a2f -> 13eb55f81627, Maintain history for compatibility with earlier migrations
INFO [alembic.runtime.migration] Running upgrade 13eb55f81627 -> 338e90f54d61, Add ``operator`` and ``queued_dttm`` to ``task_instance`` table
INFO [alembic.runtime.migration] Running upgrade 338e90f54d61 -> 52d714495f0, Add indices in ``job`` table
INFO [alembic.runtime.migration] Running upgrade 52d714495f0 -> 502898887f84, Adding ``extra`` column to ``Log`` table
INFO [alembic.runtime.migration] Running upgrade 502898887f84 -> 1b38cef5b76e, Add ``dag_run`` table
INFO [alembic.runtime.migration] Running upgrade 1b38cef5b76e -> 2e541a1dcfed, Change ``task_instance.task_duration`` type to ``FLOAT``
INFO [alembic.runtime.migration] Running upgrade 2e541a1dcfed -> 40e67319e3a9, Add ``conf`` column in ``dag_run`` table
INFO [alembic.runtime.migration] Running upgrade 40e67319e3a9 -> 561833c1c74b, Add ``password`` column to ``user`` table
INFO [alembic.runtime.migration] Running upgrade 561833c1c74b -> 4446e08588, Add ``start_date`` and ``end_date`` in ``dag_run`` table
INFO [alembic.runtime.migration] Running upgrade 4446e08588 -> bbc73705a13e, Add ``notification_sent`` column to ``sla_miss`` table
INFO [alembic.runtime.migration] Running upgrade bbc73705a13e -> bba5a7cfc896, Add a column to track the encryption state of the 'Extra' field in connection
INFO [alembic.runtime.migration] Running upgrade bba5a7cfc896 -> 1968acfc09e3, Add ``is_encrypted`` column to variable table
INFO [alembic.runtime.migration] Running upgrade 1968acfc09e3 -> 2e82aab8ef20, Rename user table
INFO [alembic.runtime.migration] Running upgrade 2e82aab8ef20 -> 211e584da130, Add TI state index
INFO [alembic.runtime.migration] Running upgrade 211e584da130 -> 64de9cddf6c9, Add ``task_fail`` table
INFO [alembic.runtime.migration] Running upgrade 64de9cddf6c9 -> f2ca10b85618, Add ``dag_stats`` table
INFO [alembic.runtime.migration] Running upgrade f2ca10b85618 -> 4addfa1236f1, Add fractional seconds to MySQL tables
INFO [alembic.runtime.migration] Running upgrade 4addfa1236f1 -> 8504051e801b, Add indices on ``xcom`` table
INFO [alembic.runtime.migration] Running upgrade 8504051e801b -> 5e7d17757c7a, Add ``pid`` field to ``TaskInstance``
INFO [alembic.runtime.migration] Running upgrade 5e7d17757c7a -> 127d2bf2dfa7, Add ``dag_id``/``state`` index on ``dag_run`` table
INFO [alembic.runtime.migration] Running upgrade 127d2bf2dfa7 -> cc1e65623dc7, Add ``max_tries`` column to ``task_instance``
INFO [alembic.runtime.migration] Running upgrade cc1e65623dc7 -> bdaa763e6c56, Make xcom value column a large binary
INFO [alembic.runtime.migration] Running upgrade bdaa763e6c56 -> 947454bf1dff, Create index on ``job_id`` column in ``task_instance`` table
INFO [alembic.runtime.migration] Running upgrade 947454bf1dff -> d2ae31099d61, Increase text size for MySQL (not relevant for other DBs' text types)
INFO [alembic.runtime.migration] Running upgrade d2ae31099d61 -> 0e2a74e0fc9f, Add time zone awareness
INFO [alembic.runtime.migration] Running upgrade d2ae31099d61 -> 33ae817a1ff4, Add Kubernetes resource check-pointing
INFO [alembic.runtime.migration] Running upgrade 33ae817a1ff4 -> 27c6a30d7c24, Add ``executor_config`` column to ``task_instance`` table
INFO [alembic.runtime.migration] Running upgrade 27c6a30d7c24 -> 86770d1215c0, Add kubernetes scheduler uniqueness
INFO [alembic.runtime.migration] Running upgrade 86770d1215c0, 0e2a74e0fc9f -> 05f30312d566, Merge migrations Heads
INFO [alembic.runtime.migration] Running upgrade 05f30312d566 -> f23433877c24, Fix MySQL not null constraint
INFO [alembic.runtime.migration] Running upgrade f23433877c24 -> 856955da8476, Fix Sqlite foreign key
INFO [alembic.runtime.migration] Running upgrade 856955da8476 -> 9635ae0956e7, Create index on ``task_fail`` table
INFO [alembic.runtime.migration] Running upgrade 9635ae0956e7 -> dd25f486b8ea, Add index on ``log`` table
INFO [alembic.runtime.migration] Running upgrade dd25f486b8ea -> bf00311e1990, Add index to ``task_instance`` table
INFO [alembic.runtime.migration] Running upgrade 9635ae0956e7 -> 0a2a5b66e19d, Add ``task_reschedule`` table
INFO [alembic.runtime.migration] Running upgrade 0a2a5b66e19d, bf00311e1990 -> 03bc53e68815, Merge migrations Heads
INFO [alembic.runtime.migration] Running upgrade 03bc53e68815 -> 41f5f12752f8, Add superuser field
INFO [alembic.runtime.migration] Running upgrade 41f5f12752f8 -> c8ffec048a3b, Add ``description`` and ``default_view`` column to ``dag`` table
INFO [alembic.runtime.migration] Running upgrade c8ffec048a3b -> dd4ecb8fbee3, Add schedule interval to dag
INFO [alembic.runtime.migration] Running upgrade dd4ecb8fbee3 -> 939bb1e647c8, task reschedule foreign key on cascade delete
INFO [alembic.runtime.migration] Running upgrade 939bb1e647c8 -> 6e96a59344a4, Make ``TaskInstance.pool`` not nullable
INFO [alembic.runtime.migration] Running upgrade 6e96a59344a4 -> d38e04c12aa2, Add ``serialized_dag`` table
INFO [alembic.runtime.migration] Running upgrade d38e04c12aa2 -> b3b105409875, Add ``root_dag_id`` to ``DAG``
INFO [alembic.runtime.migration] Running upgrade 6e96a59344a4 -> 74effc47d867, change datetime to datetime2(6) on MSSQL tables
INFO [alembic.runtime.migration] Running upgrade 939bb1e647c8 -> 004c1210f153, Increase queue name size limit
INFO [alembic.runtime.migration] Running upgrade c8ffec048a3b -> a56c9515abdc, Remove ``dag_stat`` table
INFO [alembic.runtime.migration] Running upgrade a56c9515abdc, 004c1210f153, 74effc47d867, b3b105409875 -> 08364691d074, Straighten out the migrations
INFO [alembic.runtime.migration] Running upgrade 08364691d074 -> fe461863935f, Increase length for connection password
INFO [alembic.runtime.migration] Running upgrade fe461863935f -> 7939bcff74ba, Add ``DagTags`` table
INFO [alembic.runtime.migration] Running upgrade 7939bcff74ba -> a4c2fd67d16b, Add ``pool_slots`` field to ``task_instance``
INFO [alembic.runtime.migration] Running upgrade a4c2fd67d16b -> 852ae6c715af, Add ``RenderedTaskInstanceFields`` table
INFO [alembic.runtime.migration] Running upgrade 852ae6c715af -> 952da73b5eff, Add ``dag_code`` table
INFO [alembic.runtime.migration] Running upgrade 952da73b5eff -> a66efa278eea, Add Precision to ``execution_date`` in ``RenderedTaskInstanceFields`` table
INFO [alembic.runtime.migration] Running upgrade a66efa278eea -> da3f683c3a5a, Add ``dag_hash`` Column to ``serialized_dag`` table
INFO [alembic.runtime.migration] Running upgrade da3f683c3a5a -> 92c57b58940d, Create FAB Tables
INFO [alembic.runtime.migration] Running upgrade 92c57b58940d -> 03afc6b6f902, Increase length of ``Flask-AppBuilder`` ``ab_view_menu.name`` column
INFO [alembic.runtime.migration] Running upgrade 03afc6b6f902 -> cf5dc11e79ad, Drop ``user`` and ``chart`` table
INFO [alembic.runtime.migration] Running upgrade cf5dc11e79ad -> bbf4a7ad0465, Remove id column from xcom
INFO [alembic.runtime.migration] Running upgrade bbf4a7ad0465 -> b25a55525161, Increase length of pool name
INFO [alembic.runtime.migration] Running upgrade b25a55525161 -> 3c20cacc0044, Add ``run_type`` column in ``dag_run`` table
INFO [alembic.runtime.migration] Running upgrade 3c20cacc0044 -> 8f966b9c467a, Set ``conn_type`` as non-nullable
INFO [alembic.runtime.migration] Running upgrade 8f966b9c467a -> 8d48763f6d53, Add unique constraint to ``conn_id``
INFO [alembic.runtime.migration] Running upgrade 8d48763f6d53 -> e38be357a868, Add ``sensor_instance`` table
INFO [alembic.runtime.migration] Running upgrade e38be357a868 -> b247b1e3d1ed, Add queued by Job ID to TI
INFO [alembic.runtime.migration] Running upgrade b247b1e3d1ed -> e1a11ece99cc, Add external executor ID to TI
INFO [alembic.runtime.migration] Running upgrade e1a11ece99cc -> bef4f3d11e8b, Drop ``KubeResourceVersion`` and ``KubeWorkerId``
INFO [alembic.runtime.migration] Running upgrade bef4f3d11e8b -> 98271e7606e2, Add ``scheduling_decision`` to ``DagRun`` and ``DAG``
INFO [alembic.runtime.migration] Running upgrade 98271e7606e2 -> 52d53670a240, fix_mssql_exec_date_rendered_task_instance_fields_for_MSSQL
INFO [alembic.runtime.migration] Running upgrade 52d53670a240 -> 364159666cbd, Add ``creating_job_id`` to ``DagRun`` table
INFO [alembic.runtime.migration] Running upgrade 364159666cbd -> 45ba3f1493b9, add-k8s-yaml-to-rendered-templates
INFO [alembic.runtime.migration] Running upgrade 45ba3f1493b9 -> 849da589634d, Prefix DAG permissions.
INFO [alembic.runtime.migration] Running upgrade 849da589634d -> 2c6edca13270, Resource based permissions.
Traceback (most recent call last):
File "c:\program files\python38\lib\runpy.py", line 194, in _run_module_as_main
return _run_code(code, main_globals, None,
File "c:\program files\python38\lib\runpy.py", line 87, in _run_code
exec(code, run_globals)
File "D:\Projects\Airflow\env\Scripts\airflow.exe\__main__.py", line 7, in <module>
File "D:\Projects\Airflow\env\lib\site-packages\airflow\__main__.py", line 38, in main
args.func(args)
File "D:\Projects\Airflow\env\lib\site-packages\airflow\cli\cli_parser.py", line 51, in command
return func(*args, **kwargs)
File "D:\Projects\Airflow\env\lib\site-packages\airflow\cli\commands\standalone_command.py", line 48, in entrypoint
StandaloneCommand().run()
File "D:\Projects\Airflow\env\lib\site-packages\airflow\cli\commands\standalone_command.py", line 64, in run
self.initialize_database()
File "D:\Projects\Airflow\env\lib\site-packages\airflow\cli\commands\standalone_command.py", line 172, in initialize_database
db.initdb()
File "D:\Projects\Airflow\env\lib\site-packages\airflow\utils\session.py", line 71, in wrapper
return func(*args, session=session, **kwargs)
File "D:\Projects\Airflow\env\lib\site-packages\airflow\utils\db.py", line 645, in initdb
upgradedb(session=session)
File "D:\Projects\Airflow\env\lib\site-packages\airflow\utils\session.py", line 68, in wrapper
return func(*args, **kwargs)
File "D:\Projects\Airflow\env\lib\site-packages\airflow\utils\db.py", line 1411, in upgradedb
command.upgrade(config, revision=to_revision or 'heads')
File "D:\Projects\Airflow\env\lib\site-packages\alembic\command.py", line 320, in upgrade
script.run_env()
File "D:\Projects\Airflow\env\lib\site-packages\alembic\script\base.py", line 563, in run_env
util.load_python_file(self.dir, "env.py")
File "D:\Projects\Airflow\env\lib\site-packages\alembic\util\pyfiles.py", line 92, in load_python_file
module = load_module_py(module_id, path)
File "D:\Projects\Airflow\env\lib\site-packages\alembic\util\pyfiles.py", line 108, in load_module_py
spec.loader.exec_module(module) # type: ignore
File "<frozen importlib._bootstrap_external>", line 848, in exec_module
File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
File "D:\Projects\Airflow\env\lib\site-packages\airflow\migrations\env.py", line 107, in <module>
run_migrations_online()
File "D:\Projects\Airflow\env\lib\site-packages\airflow\migrations\env.py", line 101, in run_migrations_online
context.run_migrations()
File "<string>", line 8, in run_migrations
File "D:\Projects\Airflow\env\lib\site-packages\alembic\runtime\environment.py", line 851, in run_migrations
self.get_context().run_migrations(**kw)
File "D:\Projects\Airflow\env\lib\site-packages\alembic\runtime\migration.py", line 620, in run_migrations
step.migration_fn(**kw)
File "D:\Projects\Airflow\env\lib\site-packages\airflow\migrations\versions\0074_2c6edca13270_resource_based_permissions.py", line 342, in upgrade
remap_permissions()
File "D:\Projects\Airflow\env\lib\site-packages\airflow\migrations\versions\0074_2c6edca13270_resource_based_permissions.py", line 290, in remap_permissions
appbuilder = create_app(config={'FAB_UPDATE_PERMS': False}).appbuilder
File "D:\Projects\Airflow\env\lib\site-packages\airflow\www\app.py", line 84, in create_app
raise AirflowConfigException(
airflow.exceptions.AirflowConfigException: Cannot use relative path: `sqlite:///D:\Projects\Airflow/airflow.db` to connect to sqlite. Please use absolute path such as `sqlite:////tmp/airflow.db`.
I have made sure the AIRFLOW_HOME variable does not have spaces in it.
Operating system: Windows 11
Python: 3.8
Airflow: 2.3.0
I looked around and this is what I found:
Please set AIRFLOW_HOME. Then you can prevent this issue.
export AIRFLOW_HOME=~/airflow
The same issue is addressed here: sqlite3 raised an error after running Airflow command line
How to set AIRFLOW_HOME: https://youtu.be/M521KLHGaZc?t=768. The video sets airflow home under the C: path. Works for older versions but not 2.3.0, at least in my experience.
In Mac, If you are using a local directory, add sudo command before each airflow command.
Related
Airflow SQSSensor message filtering
Given below json:
{ "Model" : "level1" }
what is the right combination of message_filtering_match_values and message_filtering_config values? I try below but it fails:
model_operator = SQSSensor(
task_id='model_operator',
dag=dag,
sqs_queue='https://sqs.somewhere/somequeue.fifo',
aws_conn_id='aws_default',
message_filtering='jsonpath',
message_filtering_config='Model[*]',
message_filtering_match_values=['level1'],
mode='reschedule')
Error message is:
Broken DAG: [/usr/local/airflow/dags/test_dag.py] Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/airflow/utils/decorators.py", line 94, in wrapper
result = func(*args, **kwargs)
File "/usr/local/lib/python3.7/site-packages/airflow/models/baseoperator.py", line 414, in __init__
"arguments were:\n**kwargs: {k}".format(c=self.__class__.__name__, k=kwargs, t=task_id),
airflow.exceptions.AirflowException: Invalid arguments were passed to SQSSensor (task_id: model_operator). Invalid arguments were:
**kwargs: {'message_filtering': 'jsonpath', 'message_filtering_config': 'Model[*]', 'message_filtering_match_values': ['level1']}
The message_filtering / message_filtering_config / message_filtering_match_values were added recently in PR it was released in Amazon provider version 2.2.0 From the traceback we can see that these parameters are not recognized by the operator which means that you are running an older version of the Amazon provider. You should upgrade the Amazon provider to the latest version. pip install apache-airflow-providers-amazon --upgrade It's also recommended to read the documentation about constraint files. You didn't mention what Airflow version you are running nor what version of the Amazon provider so note to read the change logs in case you are upgrading major version.
Broken airflow upgrade_check command. Outputs "Please install apache-airflow-upgrade-check distribution from PyPI to perform upgrade checks"
Currently running airflow 1.10.15. Wanted to perform some tests before upgrading to 2+. So installed pip install apache-airflow-upgrade-check in the scheduler pod which installed successfully. So I then run the command airflow upgrade_check but it did not return the results that I expected. It's giving me this output in terminal
[2021-06-15 21:02:38,637] {{settings.py:233}} DEBUG - Setting up DB connection pool (PID 15732)
[2021-06-15 21:02:38,637] {{settings.py:300}} DEBUG - settings.prepare_engine_args(): Using pool settings. pool_size=5, max_overflow=10, pool_recycle=1800, pid=15732
[2021-06-15 21:02:38,735] {{sentry.py:179}} DEBUG - Could not configure Sentry: No module named 'blinker', using DummySentry instead.
[2021-06-15 21:02:38,754] {{__init__.py:45}} DEBUG - Cannot import due to doesn't look like a module path
[2021-06-15 21:02:38,916] {{cli_action_loggers.py:42}} DEBUG - Adding <function default_action_log at 0x7f9a637c3a70> to pre execution callback
Please install apache-airflow-upgrade-check distribution from PyPI to perform upgrade checks
[2021-06-15 21:02:39,266] {{settings.py:310}} DEBUG - Disposing DB connection pool (PID 15732)
What am I missing?
Updated 6/16/2021: I verified if the package was installed, I did see the package in list:
...
apache-airflow 1.10.15
apache-airflow-upgrade-check 1.3.0
apispec 1.3.3
argcomplete 1.12.2
...
The problem I had was the container was running as a non-root user which was defined in Dockerfile. If I install the package in the running pod, it will install in some local directory and when executing the airflow upgrade_check command, it cannot find the package. To work-around this issue, I need to add the packages in Dockerfile so it will be included when creating the docker image.
Apache Airflow initdb command fails, due to syntax error
I have created virtualenv for python3 using:
virtualenv -p $(which python3) ENV
Then activate the source
source /Users/myusername/ENV/bin/activate
Install the apache-airflow:
pip install apache-airflow
then which airflow yields /Users/myusername/ENV/bin/airflow
But when I try to initdb using:
airflow initdb
I get below error:
{db.py:350} INFO - Creating tables
INFO [alembic.runtime.migration] Context impl SQLiteImpl.
INFO [alembic.runtime.migration] Will assume non-transactional DDL.
WARNI [airflow.utils.log.logging_mixin.LoggingMixin] cryptography not found - values will not be stored encrypted.
ERROR [airflow.models.DagBag] Failed to import: /Library/Python/2.7/site-packages/airflow/example_dags/example_http_operator.py
Traceback (most recent call last):
File "/Library/Python/2.7/site-packages/airflow/models/__init__.py", line 413, in process_file
m = imp.load_source(mod_name, filepath)
File "/Library/Python/2.7/site-packages/airflow/example_dags/example_http_operator.py", line 27, in <module>
from airflow.operators.http_operator import SimpleHttpOperator
File "/Library/Python/2.7/site-packages/airflow/operators/http_operator.py", line 21, in <module>
from airflow.hooks.http_hook import HttpHook
File "/Library/Python/2.7/site-packages/airflow/hooks/http_hook.py", line 23, in <module>
import tenacity
File "/Library/Python/2.7/site-packages/tenacity/__init__.py", line 375, in <module>
from tenacity.tornadoweb import TornadoRetrying
File "/Library/Python/2.7/site-packages/tenacity/tornadoweb.py", line 24, in <module>
from tornado import gen
File "/Library/Python/2.7/site-packages/tornado-6.0.3-py2.7-macosx-10.14-intel.egg/tornado/gen.py", line 126
def _value_from_stopiteration(e: Union[StopIteration, "Return"]) -> Any:
^
SyntaxError: invalid syntax
Done.
(ENV) ---------------------------------------------------------
Seems like example scripts use python 2.7 and it can't recognize the function definition syntax.
Does apache-airflow package need to be fixed by the next release or I can do something to fix this?
I tried fixing this:
Use python2.7 instead of python3
then install airflow on default python 2.7 enabled on mac but this throws other errors like package "six" is not compatible.
You need to turn off the example DAGs to be loaded in config file to solve this problem. Anyway, it seems weird that airflow uses 2.7 Python when you told that it is installed into Python 3 virtual environment.
How to fake flyway migration?
Two of us made a migration script in different GIT branches. Now, I've pulled origin development branch, and I've corrected GIT merge issues, and renamed my migration script to be the last. So, the new initialization of DB and migration of DB from version of develop branch would be fine. However, I've got a lot of data in my local testing DB, so I've manually applied new migration scripts that I've pulled in GIT. However, I can't make flyway think, that everything is okay. So, How can I fake migrations? When I try to migrate, I get following error: [ERROR] Failed to execute goal org.flywaydb:flyway-maven-plugin:3.2.1:migrate (default-cli) on project db: org.flywaydb.core.api.FlywayException: Validate failed. Migration Description mismatch for migration 1.118 [ERROR] -> Applied to database : AAA [ERROR] -> Resolved locally : BBB [ERROR] -> [Help 1]
You will have to manually update Flyway's metadata table (called schema_version by default)
Upgrade failed - Plone 4.3.7 to Plone 5.0
I'm trying to upgrade Plone 4.3.7 to Plone 5.0 via the portal_migration tool, and encounter the following error. Any thoughts? This is simple site (no add-ons), but it dates back to Plone 2.x, so there may be some old crud left that I've forgotten about.
Output of UPGRADE tool:
Dry run selected.
Starting the migration from version: 4311
Ran upgrade step: Miscellaneous
Role / permission map imported.
Archetype tool imported.
Step languagetool has an invalid import handler
Step kupu-setup has an invalid import handler
Ran upgrade step: Run to50alpha3 upgrade profile
Ran upgrade step: Upgrade editing control panel settings
Ran upgrade step: Upgrade maintenance control panel settings
Ran upgrade step: Upgrade navigation control panel settings
Ran upgrade step: Upgrade search control panel settings
Ran upgrade step: Upgrade site control panel settings
Role / permission map imported.
Skins tool imported.
Archetype tool imported.
Step languagetool has an invalid import handler
Step kupu-setup has an invalid import handler
Ran upgrade step: Run to50beta1 upgrade profile
Ran upgrade step: Upgrade markup control panel settings
Ran upgrade step: Upgrade mail control panel settings
Ran upgrade step: Upgrade security control panel settings
Upgrade aborted. Error:
Traceback (most recent call last):
File "/usr/local/Plone/buildout-cache/eggs/Products.CMFPlone-5.0-py2.7.egg/Products/CMFPlone/MigrationTool.py", line 257, in upgrade
step['step'].doStep(setup)
File "/usr/local/Plone/buildout-cache/eggs/Products.GenericSetup-1.8.0-py2.7.egg/Products/GenericSetup/upgrade.py", line 166, in doStep
self.handler(tool)
File "/usr/local/Plone/buildout-cache/eggs/plone.app.upgrade-1.3.18-py2.7.egg/plone/app/upgrade/v50/betas.py", line 63, in upgrade_portal_language
lang_settings.use_content_negotiation = portal_languages.use_content_negotiation
AttributeError: use_content_negotiation
Starting upgrade of core addons.
Done upgrading core addons.
End of upgrade path, migration has finished
The upgrade path did NOT reach current version
Migration has failed
Dry run selected, transaction aborted
If I just try to view the site itself, I see a blank page with this error message:
KeyError('Interface `Products.CMFPlone.interfaces.controlpanel.ILanguageSchema`
defines a field `available_languages`, for which there is no record.',)
(Also, the following error occurred while attempting to render the
standard error message, please see the event log for full details:
Interface `Products.CMFPlone.interfaces.controlpanel.ILanguageSchema`
defines a field `available_languages`, for which there is no record.)
At the debug mode console, I see repeated error messages like this:
2015-10-09 13:52:28 INFO plone.app.upgrade Dry run selected.
2015-10-09 13:52:28 INFO plone.app.upgrade Starting the migration from version: 4311
2015-10-09 13:52:28 INFO plone.app.upgrade Ran upgrade step: Miscellaneous
2015-10-09 13:52:28 INFO Products.GenericSetup.tool Importing profile profile-plone.app.upgrade.v50:to50alpha3 with dependency strategy upgrade.
2015-10-09 13:52:28 INFO Products.GenericSetup.tool Applying main profile profile-plone.app.upgrade.v50:to50alpha3
2015-10-09 13:52:29 INFO GenericSetup.rolemap Role / permission map imported.
/usr/local/Plone/buildout-cache/eggs/Products.CMFCore-2.2.10-py2.7.egg/Products/CMFCore/DirectoryView.py:493: UserWarning: DirectoryView plone_deprecated refers to a non-existing path 'Products.CMFPlone:skins/plone_deprecated'
(self.id, reg_key), UserWarning)
/usr/local/Plone/buildout-cache/eggs/Products.CMFCore-2.2.10-py2.7.egg/Products/CMFCore/DirectoryView.py:493: UserWarning: DirectoryView plone_styles refers to a non-existing path 'Products.CMFPlone:skins/plone_styles'
(self.id, reg_key), UserWarning)
/usr/local/Plone/buildout-cache/eggs/Products.CMFCore-2.2.10-py2.7.egg/Products/CMFCore/DirectoryView.py:493: UserWarning: DirectoryView classic_ecmascript refers to a non-existing path 'plonetheme.classic:skins/classic_ecmascript'
(self.id, reg_key), UserWarning)
2015-10-09 13:52:29 INFO GenericSetup.archetypetool Archetype tool imported.
2015-10-09 13:52:29 ERROR GenericSetup Step languagetool has an invalid import handler
2015-10-09 13:52:29 ERROR GenericSetup Step kupu-setup has an invalid import handler
2015-10-09 13:52:29 INFO plone.app.upgrade Ran upgrade step: Run to50alpha3 upgrade profile
2015-10-09 13:52:29 INFO plone.app.upgrade Ran upgrade step: Upgrade editing control panel settings
2015-10-09 13:52:29 INFO plone.app.upgrade Ran upgrade step: Upgrade maintenance control panel settings
2015-10-09 13:52:29 INFO plone.app.upgrade Ran upgrade step: Upgrade navigation control panel settings
2015-10-09 13:52:29 INFO plone.app.upgrade Ran upgrade step: Upgrade search control panel settings
2015-10-09 13:52:29 INFO plone.app.upgrade Ran upgrade step: Upgrade site control panel settings
2015-10-09 13:52:29 INFO Products.GenericSetup.tool Importing profile profile-plone.app.upgrade.v50:to50beta1 with dependency strategy upgrade.
2015-10-09 13:52:29 INFO Products.GenericSetup.tool Applying main profile profile-plone.app.upgrade.v50:to50beta1
2015-10-09 13:52:29 INFO GenericSetup.rolemap Role / permission map imported.
2015-10-09 13:52:29 INFO GenericSetup.skins Skins tool imported.
2015-10-09 13:52:29 INFO GenericSetup.archetypetool Archetype tool imported.
2015-10-09 13:52:29 ERROR GenericSetup Step languagetool has an invalid import handler
2015-10-09 13:52:29 ERROR GenericSetup Step kupu-setup has an invalid import handler
2015-10-09 13:52:29 INFO plone.app.upgrade Ran upgrade step: Run to50beta1 upgrade profile
2015-10-09 13:52:29 ERROR PortalTransforms Cannot register transform html-to-captioned (ImportError), using BrokenTransform: Error
No module named html2captioned
2015-10-09 13:52:29 INFO plone.app.upgrade Ran upgrade step: Upgrade markup control panel settings
2015-10-09 13:52:29 INFO plone.app.upgrade Ran upgrade step: Upgrade mail control panel settings
2015-10-09 13:52:29 INFO plone.app.upgrade Ran upgrade step: Upgrade security control panel settings
2015-10-09 13:52:29 ERROR plone.app.upgrade Upgrade aborted. Error:
Traceback (most recent call last):
File "/usr/local/Plone/buildout-cache/eggs/Products.CMFPlone-5.0-py2.7.egg/Products/CMFPlone/MigrationTool.py", line 257, in upgrade
step['step'].doStep(setup)
File "/usr/local/Plone/buildout-cache/eggs/Products.GenericSetup-1.8.0-py2.7.egg/Products/GenericSetup/upgrade.py", line 166, in doStep
self.handler(tool)
File "/usr/local/Plone/buildout-cache/eggs/plone.app.upgrade-1.3.18-py2.7.egg/plone/app/upgrade/v50/betas.py", line 63, in upgrade_portal_language
lang_settings.use_content_negotiation = portal_languages.use_content_negotiation
AttributeError: use_content_negotiation
2015-10-09 13:52:29 INFO plone.app.upgrade Starting upgrade of core addons.
2015-10-09 13:52:29 INFO Products.GenericSetup.tool No upgrades available for profile Products.CMFEditions:CMFEditions. Profile stays at version ('4',).
2015-10-09 13:52:29 WARNING Products.GenericSetup.tool Version of profile Products.CMFPlacefulWorkflow:CMFPlacefulWorkflow is unknown, refusing to upgrade.
2015-10-09 13:52:29 WARNING Products.GenericSetup.tool Version of profile plone.app.contenttypes:default is unknown, refusing to upgrade.
2015-10-09 13:52:29 WARNING Products.GenericSetup.tool Version of profile plone.app.dexterity:default is unknown, refusing to upgrade.
2015-10-09 13:52:29 INFO Products.GenericSetup.tool No upgrades available for profile plone.app.discussion:default. Profile stays at version ('102',).
2015-10-09 13:52:29 WARNING Products.GenericSetup.tool Version of profile plone.app.event:default is unknown, refusing to upgrade.
2015-10-09 13:52:29 WARNING Products.GenericSetup.tool Version of profile plone.app.iterate:plone.app.iterate is unknown, refusing to upgrade.
2015-10-09 13:52:29 WARNING Products.GenericSetup.tool Version of profile plone.app.multilingual:default is unknown, refusing to upgrade.
2015-10-09 13:52:29 INFO Products.GenericSetup.tool No upgrades available for profile plone.app.querystring:default. Profile stays at version ('11',).
2015-10-09 13:52:29 WARNING Products.GenericSetup.tool Version of profile plone.app.theming:default is unknown, refusing to upgrade.
2015-10-09 13:52:29 WARNING Products.GenericSetup.tool Version of profile plone.app.users:default is unknown, refusing to upgrade.
2015-10-09 13:52:29 INFO plone.app.upgrade Done upgrading core addons.
2015-10-09 13:52:29 INFO plone.app.upgrade End of upgrade path, migration has finished
2015-10-09 13:52:29 ERROR plone.app.upgrade The upgrade path did NOT reach current version
2015-10-09 13:52:29 ERROR plone.app.upgrade Migration has failed
2015-10-09 13:52:29 INFO plone.app.upgrade Dry run selected, transaction aborted
Are there any 3rd-party products installed? Maybe LinguaPlone? The important part here is AttributeError: use_content_negotiation, so it seems your migration is stuck somewhere into Products.PloneLanguageTool. You may try "updating" your portal_languages object in ZMI from a new Plone site created in the same instance. Or uninstalling LinguaPlone before migration if that is possible (ie: there isn't too much content using it).